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Core digital transformation metrics in banking 


|. Laggards | Leaders 


Mobile app adoption Digital sales 
% of total customers active on mobile app % of sales through digital channel 
over past 90 days 


+14 

percentage 

points +32 

ere percentage 

points 
2018 2022 2018 2022 
Branch network staffing Contact center staffing 
Percentage point change in average branch Percentage point change in average inbound 
network FTEs per 100k customers contact center FTEs per 100k customers 
Between 2018 and 2022 Between 2018 and 2022 


Source: Finalta Global Digital Benchmark. Global Contact center metrics only available after 2019 
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1. Business-led 


To align the senior leadership team оп the transformation 


vision, value, and roadmap ... 


Еш digital roadmap 
£2 
= a ... and reimagining business domains to 
© = deliver outstanding customer experiences ада Business 
3 о and lower unit cost Domain Domain 
2. Talent 3. Operating model 4. Technology 5. Data 
To ensure you To increase the To allow your To continuously 
2 have the right metabolic rate of the organization to enrich data and 
Е Е skills and organization by more easily use make it easy to 
ul al capabilities to bringing business, technology to consume across the 
ü m execute and operations and innovate with pace organization to 
a ® innovate technology together improve customer 
o experiences and 
business operations 
E H 
wá 9. Adoption and scaling 
© ЕТ To maximize value capture by ensuring the adoption and enterprise scaling of digital solutions 
= 9 and by tightly managing the transformation progress and risks 
oz 
«x 
z 


EXHIBIT 1.2 


Digital vision example 


Example for a consumer packaged goods company 


ASPIRATION 


REIMAGINING 
OUR BUSINESS 


NEW DIGITAL 


CAPABILITIES 
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Business goals 


Drive new sources of growth via 
direct-to-consumer personalization 
and become the best CPG 
company in serving our retail 
customers 


Financial goals 


Create $1 billion lift in verifiable 
annual earnings before interest 
and taxes (EBIT) by 20XX 


Insights-driven 
consumer journey 


Enable personally relevant 
consumer interactions via 
tailored messages, offerings, 
and experiences 


Category and customer growth 


Develop insights and execute 
strategies to profitably grow 
categories and serve as thought 
partner to retailers 


Innovation 


Leverage data-mining to better 
understand unmet consumer needs 
and accelerate renovation of core 
categories 


Supply-chain advantage 


Support optimal level of complexity 
and service at the lowest delivered 
cost 


Talent 


Field a core bench of digital 
talent, and increase digital 
proficiency of the broader 
workforce 


Tech 


Adopt modern, open, modular 

cloud-based architecture; build 
and customize for competitive 

differentiation 


Agile operating model 


Create empowered interdisciplinary 
teams, deployed to and led by the 
business to develop our proprietary 
digital solutions 


Data 


Invest in developing proprietary 
data assets that will differentiate 
our customer and consumer 
experience 


Three ways to define a domain 


Workflow/Process 


High-value business 
processes like asset 
maintenance, customer 


Journeys 


Interaction-intensive 
processes like customer 
onboarding, providing 


Function 


Traditional business 
functions, such as sales, 


finance, marketing, or supply 


care, or procure-to-pay customer advice, or chain 


buying a product online 


Most companies choose to organize their domains by 
workflows or journeys, as this tends to offer the greatest 
value to customers and/or employees. 


Example of domains in a consumer packaged goods company 


FRONT OF HOUSE OPERATIONS 

Personalized marketing Integrated supply chain People 
planning 

Store execution Finance 
Logistics 

Digital engagement Legal 


Manufacturing 


Innovation/R&D 


Procurement 


Revenue management 
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Domains аге prioritized based on value 
and feasibility 


Example consumer packaged goods company 


HIGH Manufacturing 


Revenue 
e management Prioritized domains 
Logistics e Procurement 
VALUE 
* Customer © © 
experience e го | 
e Financial execution БЕРЕР Personalized 
benefits chain marketing 
e Speed to value planning 
* Synergy with 
other domains 
Innovation/R&D Digital ' 
n men 
Low engageme 
LOW HIGH 
e Executive sponsorship e Ease of adoption 
e Data readiness e Ease of enterprise 
e Technology readiness scaling 
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Five steps for the domain reimagination 


Problem to solve 


Articulate the 
business problem to 
be solved — user 
unmet need or 
process pain points. 
Be clear on the 
improvement lever to 
activate to solve the 
problem. 


EXHIBIT 3.1 


-0 


Solutions and 
use cases 


Identify the digital 
solutions and 
underlying use-cases 
required to address 
the “problem to be 
solved.” 


„Ө 


Data and tech 
requirements 


Assess the data 
landscape and 
technology stack 
against the target 
solution architecture. 
Understand the gaps 
and investments 
needed. 
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Impact and 
investments 


Estimate the impact 
these solutions could 
achieve by specifying 
how each Іемег/КРІ 
could improve. 
Roughly estimate the 
required investments. 


ө -о 


Implementation 
plan 


Articulate change 
management 
requirements to 
realize the full value 
and develop an 
implementation 
Sequence. Specify 
leadership and 
accountabilities. 


Cascading from business domain to value 
levers, solutions, and use cases 


Business 
domain 
Ж 
Value levers LEVER I LEVER II LEVER Ш 
AN ^ А 
Solutions SOLUTION 1 SOLUTION 2 SOLUTION 3 SOLUTION 4 
^M ^N ^M SN 

Use cases/ Use case 1.1 Use case 2.1 Use case 3.1 Use case 4.1 

models 
Use case 1.2 Use case 2.2 Use case 3.2 Use case 4.2 
Use case 1.3 Use case 3.3 Use case 4.3 

Use case 3.4 

Business A customer/user journey or a core business process — sizeable enough 

domain such that the value from transforming it would be meaningful 

Value Core business outcomes that are driven by the transformation of the 

levers domain, such as new customers, churn, cost to serve, NPS, etc. 

Solutions Solutions provide value to a customer or a user, such as a weather 
app or a mortgage sales platform 

Use cases A solution is typically composed of use cases. In the case of a weather app, the use cases 
might be forecasts for temperature, humidity, and wind. For a mortgage sales platform, the 
use cases might be customer onboarding, customer credit check, and mortgage pricing 
calculator 
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Case study: Personalized marketing 


Personalized marketing domain at a CPG company 


Business domain PERSONALIZED MARKETING 


^ 
Value levers MARKETING 
RETURN ON ADVERTISING SPEND (ROAS) NON-WORKING COSTS 
^M ^M 
А AGILE PERSONALIZED AGENCY/CONTENT 
Solutions CONSUMER 360 MARKETING ECOSYSTEM 
Use cases/ Integrated consumer Audience opportunity sizing Content grid model 
models 360 profiles 
Campaign effectiveness Performance tool 
Audiences/ (e.g., content and media 
money map Media channel spend performance across channels) 
analysis 
Predictive growth Full-funnel optimization model 
analytics Propensity model against 
Specific audiences 
Data, not exhaustive Technology, not exhaustive 


Point Owned 
of sale media 
data platforms 


Brand 
websites Digital Asset Campaign 
Management pilots 


Sensory/ Social 
E-commerce testing listening 


data data data 
Data 


Management 
Platform 


Marketing Loyalty 
Rol card data 


Product 
Information 


aed Management 


equity data 
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Typical roles in an agile pod 


Not exhaustive 


Provide business and functional expertise 


[225] Ргоаисї омпег [ 3] Subject matter expert PB Business/process analyst 
Aa; Defines and ЗІ Brings expertise and 8-8 Brings understanding of 
prioritizes product knowledge of end-to-end business 
roadmap and business, functions, process, supports 
backlog operations, legal, risk, development of business 
and compliance case, OKR tracking, and 


change management effort 


Create user experience for the solution 


CJ Design lead О UI/UX designer 
000 Leads customer-centric design, Ç Creates user experiences that capture 
Бл develops user engagement plan, and business value and meet customer needs 


conducts user testing 


Conceptualize technical architecture, develop code, and run solution in production 


Software engineer! пїп) Data engineer 
(ЕН Develops code, writes unit tests, and О Builds data pipelines to drive analytics 
drives integrations solutions from different data sources 


DATA SCIENCE/AI 


Analyze data to identify key insights for the solution 


Machine learning engineer 


(fe Analyzes and mines business data to аг Implements ML models into production 
І identify patterns and builds predictive ensuring performance and stability of model 
models 


SUPPORT? 


Deliver additional guidance to the team 


о li Data scientist 
І 


д, Scrum master в Agile coach 
Oversees scrum process and helps (ТЕ! Supports and coaches the scrum team 
AYO the self-managing team achieve its | on agile development practices 


goals 
Note: List is not exhaustive. 


1. Software engineers cover full-stack developers, solution architects, cloud engineers, and DevOps engineers. 
2. These roles diminish as pods gain maturity. 
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Pod archetypes and typical staffing 
by solution life cycle 


Examples — will vary by industry and company 


DIGITAL INTENSIVE SOLUTIONS 


Discovery 
1 Product owner 


Proof-of-concept/MVP 
1 Product owner 


Solution life stages 


Production 
1 Product owner 


> 


Change management 
1 Product owner 


1 Design lead 


1 Scrum master 


1 Scrum master 


1-2 Change agents? 


0.5 Software engineer’? 


1 Design lead 


1 Design lead' 


1 Business/ 
process analyst 


1 SME 


1 UI/UX designer 


1 UI/UX designer 


2-3 Software engineers'? 
1-2 SMEs 


ANALYTICS INTENSIVE SOLUTIONS 


2-3 Software engineers? 
1-2 SMEs 


1 Business analyst! 


Discovery 
1 Product owner 


Proof-of-concept/MVP 
1 Product owner 


Production 
1 Product owner 


Change management 
1 Product owner 


0.5 Data scientist 


1 Scrum master! 


1 Scrum master! 


1-2 Change agents? 


0.5 Data engineer 


2 Data scientists 


1 Change agent 


1 Business analyst 


2 Data engineers 


1 UI/UX designer! 


1 SME 


1 Business analyst 


1 Data engineer 


1 SME 


DATA INTENSIVE SOLUTIONS 


2 Machine learning 
engineers 


1 Business analyst 


1 Business analyst' 


Discovery 
1 Data product owner 


Proof-of-concept/MVP 
1 Data product owner 


Production 
1 Data product owner 


Change management 
1 Product owner 


1 Data architect 


1 Scrum master 


1 Scrum master 


1-2 Change agents? 


1 Data engineer 


1 Data architect 


1 Data architect 


1 Data SME 


2—3 Data engineers 


2—3 Data engineers 


1 Business analyst 


1—2 Software engineers? 
1—2 Data SMEs 


1-2 Software engineers? 


1 Business analyst! 


1. Optional/as needed. 2. Software engineers cover full-stack developers, solution architects, cloud engineers, and DevOps 
engineers. 3. Pod members who are active promoters of change, working to embed new solutions and build organizational 
buy-in by embracing new processes, addressing questions and concerns, and resolving implementation challenges. 
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Estimating overall talent needs 


Archetypes for each use case per quarter 


Q1 Q2 Q3 Q4 Q5 Q6 
DOMAIN: PERSONALIZED MARKETING 
Solution: Use case: 
А Data Data Data Data Data Data 
Build Ingest internal data Discovery | Discovery РОО РОС Prod. Bd 
consumer 360 Data Data Data Data Data Data 
d ata asset Ingest external data Discovery | Discovery PoC PoC Prod. Prod. 
| ; ; Data Digital Digital Digital Digital 
Build АР! and consumption interfaces Discovery — PoC PoC Prod. Prod. 
A ; ; Analyti Analyti Analyti Analyti Analyti Analyti 
Activate Develop personalized offerings Diesen. ыма | mede КОА | a 
digital 
2 i А Digital Digital Digital Digital Digital 
marketing Activate paid search = Discovery PoC PoC Prod. Prod. 
campaign : ; Digital Digital Digital Digital 
Activate own e-commerce site = - Discovery PoC PoC Prod. 
DOMAIN: SUPPLY CHAIN 
ы КЕТ E x Data Data Data Data Data Data 
Build supply Build inbound material data twin Discovery | Discovery | PoC PoC Prod. Prod. 
chain digital 
а " Я Я ; Data Data Data Data Data Data 
twin Build operations transformation data twin Discovery | Discovery PoC PoC Prod. Prod. 
; - ; Data Data Data Dat Data Dat: 
Build outbound finished products data twin Discovery | Discovery | PoC PC. Prod. Prod 
m" e" " ; Digital Digital Digital Digital Digital Digital 
Develop digital | Develop on-time delivery metrics Biovail ee ee. Baa. Prod. | Chg. rman 
control tower 
inti, n Analytics Analytics Analytics Analytics 
Develop predictions based on sc twin = ЕР Discovery PoC Prod. Prod. 
DOMAIN: PROCUREMENT 
Н Data Data Data Data Data Data 
Create spend Consolidate Spend data Discovery | Discovery PoC PoC Prod. Prod. 
transparenc ТӘНГЕ = = Т mm m 
р У Create data for product specification fields = быт ps s Doa Dam 
i i Digital Digital Digital Digital 
Upload in spend analytics tools = = beer OC a Pid. 
Develop should-be analytic models E НІН Beer аа bin 
Estimated Qi | Q2 03 | Q4 | Q5 | Q6 
oin d Product owners 3 6 14 20 16 16 
пееае 
Data architects & data engineers 23 22 37 20 38 38 
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Design leads & UI/UX designers 


Software engineers 1 4 26 43 30 29 
Tech leads 11 10 10 8 10 10 
Data scientists & ML engineers 1 3 5 9 10 10 
Scrum masters & agile coaches 11 13 32 15 24 24 
SMEs 3 7 16 27 16 14 


Оіһег 
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Assessing digital capabilities 


Capability ranking survey results by category, on scale of 1—5' 


€ Example CPG company 9 Industry average? 6 Digital and Al leader average? 


ROADMAP 


1 2 3 4 5 


Bold vision 

Linked to business strategy 
Executive alignment 
Business case 


TALENT 


A Ss 


Leadership 

Talent strategy 
Skills 

Talent management 


OPERATING MODEL 


Agile methodology 
Structure and roles 
Funding and governance 
Control functions 


TECHNOLOGY 


Distributed Architecture 
Cloud/infrastructure 
DevSecOps 

Security 


DATA 


Data vision and strategy 
Data architecture 

Data products 

Data governance 


ADOPTION & SCALING 


Solution adoption 

Scaling approach 
Performance management 
Change management 


1. 1 = lagging; 5 = best-in-class. 2. Average of top quintile of companies (from CPG industry) in the McKinsey Digital Quotient 
(DQ) database, across geographies. 3. Average of top quintile companies in the DQ database, across industries and geographies 
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Look-back perspective on digital investments 


Global food producer example 


RUN-RATE POTENTIAL OF 


NUMBER SOLUTIONS AT THIS STAGE 
PROJECTION PROGRESSION OF SOLUTIONS % of total company EBITDA 
Idea validated to address 160 <1% 
business problem 
Concept tested and ready 
PILOT, % 
EAE for business case 35 «1% 
Business case approved 30 <1% 
PROPOSAL and solution build starts 
IMPLEMENTATION Partial roll-out 35 <1% 
PRODUCTION Full roll-out and scaling 20 <1% 
STOPPED No longer active 120 <1% 
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Key elements of a capability-building plan 


Typical elements for first 18-24 months 


TALENT 


OPERATING 


MODEL 


TECHNOLOGY 


CHANGE 
MANAGEMENT 


Talent needs: 
number and type 
of technologists 
needed, for year 
1, at minimum 
(Ch. 4) 


Talent sourcing: 
setup of Talent 
Win Room (Ch. 9) 
and sourcing plan 
(Ch. 10) 


Training programs 
for executives, 
domain leaders, 
and pod members 
(Ch. 12) 


Approach to train 
teams in agile 
working 
methodologies 
(Ch. 13) 


Future state 
operating model 
and transition 
plan (Ch. 14) 
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Future-state tech 
stack architecture 
to support priority 
domains (Ch. 17) 


Approach to 
address cloud 
migration needs for 
priority domains 
(Ch. 18) 


Approach to 
implementing 
DevSecOps and 
support developers 
(Ch. 18) 


Resourcing and investment required per quarter 
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Plan for 
accessing and 
conditioning key 
data elements for 
priority domains 
(Ch. 24) 


Building of 
priority data 


products (Ch. 25) 


Future-state data 
architecture 
(Ch. 26) 


Setup of 
transformation 
office (Ch. 30) 


System to track 
value created 
by digital 
solutions 

(Ch. 30) 


Broad-based 
organizational 
training on 
digital (Ch. 32) 


Strategic roadmap for the entire transformation 


Example for consumer PHASE 1 PHASE 2 PHASE 3 
packaged goods company Develop digital ^ Transform lighthouse domains and Scale impact 
roadmap – 20XX build digital capabilities - 20XY — 20XZ 
Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 


FOUNDATIONAL CAPABILITIES 


Digital roadmap В DESIGN 


Digital talent buildout DESIGN 


Talent tech training DESIGN ШЕ Discovery 


Agile operating model: Design DESIGN _ Proof Сане 
and implement digital factory Production solution 


Technology: Cloud readiness DESIGN 


Data: Architecture and ingestion DESIGN 


DOMAINS 
PERSONALIZED MARKETING 
Build consumer 360 data asset =z 


Activate digital 
marketing campaigns == 


SUPPLY CHAIN 

Build supply chain digital twin ЕЕБЕН 
Improve responsiveness 
with digital control tower 


PROCUREMENT 
Create spend transparency шн —_ 


Develop should-be cost analytics = 


CHANGE MANAGEMENT 


Communication and engagement 
Milestone and value tracking 


Risk management 


FINANCIALS 


EBITDA improvement 3 15 27 45 63 


Cash investments 5 8 12 10 10 8 8 


Net cash -5 -8 -12 -7 +5 +19 +37 +55 
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Digital talent skills taxonomy 


TIER 1: SKILL FAMILIES 


Agile Cloud Database/data warehouse 
Analytics and reporting Data engineering Design 
15 total Operations/ ; 
families DevOps infrastructure services Automation 
Testing Product management Data science 


Architecture 


Security 


TIER 2: SKILL SUB-GROUPS 


~110 
subgroups 


Cloud 
development 


development 


TIER 3: SKILLS 


~650 
skills 
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Testing of coding capabilities for 


a 100-person digital team 


Measure of coding capabilities, 0 = lowest, 100% = highest 


Test Internal resources 


Scores Total: 76 individuals 


External resources 
Total: 34 


Did not 
стрес ЕНЕ +7 


8 


Note: Each employee tested for the coding capability of their choice, including Python, Java, Android Kotlin, etc. 
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Example of digital and technology talent gap analysis 


Global insurance company (N) Novice ©) Competent [J Resources to release _ Resources to add 


Category 


Software 


Chapter 


Front-end engineering —71 


Current state 


Future needs 


Difference 


® o ® © и © 


Integration engineering — 502 410 514 2,056 | -12 | EH 
Full-stack engineering — | 
QA engineering 44 36 27 108 
Architecture Architecture 33 80 26 103 
Infrastructure SRE 47 78 27 108 
DevOps 12 19 27 108 
Cloud engineering 6 10 11 43 
Infrastructure engineers 113 184 66 263 
Data and analytics Data and analytics 74 91 54 216 
Security Security 84 102 34 136 
Design Experience design 4 7 9 34 
Product management Product owner 96 179 69 275 
Agile Agile practitioner 15 55 11 44 
Other Program manager 58 217 3 14 
Leadership (e.g., VP+) 0 198 0 64 
Nonpod roles (e.g., Admin) 0 362 0 274 
Internal FTEs 1,088 2,028 878 3,846 2108 
Total internal 3,116 4,724 
Total external 4,826 2,024 42,802 


Internal; external 


39%; 61% 


70%; 30% 


Note: Based on tech talent skills survey with 1 (novice) through 5 (expert) scale, where novice means participants who rated 
1 to 2 while competent means participants who rated 3 to 5. 
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Estimating overall talent need and 
building a hiring plan 


Global agriculture company 


Q1 Q2 
Role Demand Supply Gap Hire Contract Reskill | Hire Contract Reskill 
Product owner 20 2 18 5 5 0 8 0 10 
Scrum master 10 3 7 5 2 0 7 0 0 
Change agent 5 Many - 0 0 0 0 0 0 
Design lead 3 0 3 1 0 0 2 0 0 
UI/UX designer 17 0 17 3 7 0 6 7 0 
Data scientist 6 1 5 2 0 0 3 0 2 
Data engineer 18 5 18 5 7 0 10 3 0 
Software engineer 43 12 31 8 13 0 12 15 2 
Machine learning engineer 0 3 0 0 0 1 0 0 
Tech lead 8 2 6 2 2 0 5 1 0 
Data architect 0 2 0 1 0 1 0 0 
Agile coach 5 0 5 2 2 0 4 1 0 
Business analyst 15 Many - 0 0 0 0 0 0 
SME 27 Many - 0 0 0 0 0 
Total 182 NA 110 31 39 0 59 27 14 
L | L | 
то 100 
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Typical roles in a talent win room (TWR) 


X96 | Time dedicated Е Digital talent team 


Talent Win Room Product Owner | 100% 


Set strategic direction and priorities for TWR 


Day-to-day leader to oversee execution 


Scrum Master | 100% 


Keep team on track, organized, and focused 


Ensure the correct execution of agile 
practices 


В Senior leadership 


External support (temporary) 


Executive Sponsor 10-20% 


Present as needed to align with wider 
organization and set strategic goals 


Experts Varies 


Provide expertise in key impact areas 
(e.g., key roles to be hired, design 
thinking to reimagine candidate and 


employee experience) 


Ё 
м 


Talent Attraction Lead 100% е 


Develop а compelling employee value 
proposition based on industry benchmarking 
and consistent with company values 


г Recruiting augmentation | 100% 


ai 


Career Paths & Performance 


100% 


Р; 


Management Lead 


Consultants developing the 
recruitment framework, incl. attract, 
assess, and onboard activities 


Shape performance management strategy, 
career paths design, and diversity and 
inclusion 


Temporary recruiting support 


Learning and Development Lead | 100% 


Set L&D strategy and operationalize the 


learning journeys 


e 


Sample metrics 


Set L&D/talent development goals by role & KPls used by TWR 


% 
TOR 


Digital Recruiter(s) 100% Time to hire 


% conversion rate per stage of 


Drive recruiting process and associated recruiting process 
metrics 

Source yield 
Champion candidate-centric recruiting 


experience Employee satisfaction 


DEI metrics and targets 


Compensation Specialist 20% 


Employee performance metrics 


Ensure a competitive compensation 
offering for talent 
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The most important job factors for software talent 


Percentage of software talent that chose a factor in the top three reasons why they took a 
job, plan to stay in a job, plan to leave a job, or left 


Career development and 
advancement potential 


TOOK 
A JOB 


43% 


РГАМ 
TO LEAVE 


LEFT 


Compensation and 
financial-related factors 


40 


Workplace flexibility mE 30 27 E 23 
Meaningful work mM 29 NE 22 | | 21 
Support for employee 

health and well-being 8 20 = 19 


Source: McKinsey Software Talent Great Attrition, Great Attraction Survey, 2022 (N = 1,532) 
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Example EVPs - overall and digital 


JOHNSON & JOHNSON PHARMACEUTICALS 


OVERALL EVP: Working with Johnson & 
Johnson isn't just any job. Every day, we're 
creating life-changing treatments for infectious 
diseases, improving global health equity, and 
developing medtech innovations, 
pharmaceuticals, and consumer health 
products that enhance quality of life for people 
worldwide. From 3D printing and robotics that 
are transforming surgical procedures to 
drones delivering vaccines to remote regions, 
our work is bigger than all of us. 


DIGITAL EVP: Imagine empowering AI with the 
accumulated medical knowledge of humankind, building 
natural language processing applications to make surgery 
safer or using machine learning to transform how rare 
diseases are diagnosed. Data science not only makes 
breakthroughs like these possible but accelerates our 
impact — it's how teams at Janssen R&D are shortening 
clinical trials, for example. And as the world's largest and 
most broadly based healthcare company, we're leveraging 
our expansive data sets to address the biggest health 
challenges of our time, from HIV to bladder cancer, lupus 
and COVID-19. 


FREEPORT-MCMORAN 


OVERALL EVP: Our skilled and versatile 
team finds, extracts, processes and provides 
the raw materials that connect the world. 
Copper. Molybdenum. Gold. The elements we 
supply play a crucial role in delivering the 
technology that drives the future. 


We believe our greatest strength is our people. 


We respect and value the different ideas, 
beliefs, experiences, talents, skills, 
perspectives, backgrounds and cultures of our 
workforce. We strive for, promote and foster a 
workplace where everyone feels a sense of 
belonging, is treated with respect and their 
opinions are valued. 


DIGITAL EVP: At Freeport we understand that our data 
does not reach its full potential until it is analyzed, and 
insights effectively communicated to the enterprise. You 
will work in close collaboration with mining operations, 
subject matter experts, data scientists, and software 
engineers to develop advanced, highly automated data 
products. You will be a champion of DataOps, DevOps, 
and agile practices; leading project teams and mentoring 
team members to realize their full potential. 


Source: Johnson & Johnson and Freeport-McMoran company career websites 


EXHIBIT 10.2 


Current state recruiting journey Financial services company 


| РНАЕ > SOURCE / SEARCH (3-4 weeks) SCREENING (1 week) 


Step (D: Create requisition 
Step (2): Requisition approved by finance/HR (2): Schedule screening call 
Step (8): Talent acquisition team assigns requisition to recruiter (9: Conduct screening call 
Step (2): Post the position 
Step (5): Digital application 


э» лон өө ojojojo © 


Touch points 


Candidate 
experience 
Actions, 
thoughts, 
feeling at key 
moments 


Recruiter 
experience 


Hiring 
manager 
experience 


EXHIBIT 10.3 


Recruiting system 


Motivated 


(1): Assess application 


LinkedIn, Application : Email, Video 
Email 
etc. portal phone call| conf. 


Frustrated, ОК 
| Scheduling \ Screening 
| delayed \ call 


| \ 


Excited/ | 
curious/ | 


OK 


à zl EN 
Starts to look for new position uncertain ^ Applies z 
or open to new opportunities Reads job for Anxious 
Waits to Upset Upset 


hear back Looks | Withdraws 
elsewhere | application 


Anxious 


Doesn’t know 
what's next in queue, 
doesn't have 
a pool of candidates 


Stressed 
Writes JD; | Frustrated 
Process is Waits 


slow and during 
tedious | requisition 
approval 
process 


posting | position 


Stressed 
| Waits for 
EN scheduling Hopeful 


* 


| Waitin | X 
Over- Stressed | for ш Stressed © Conducts 


screenin 
whelmed | Starts | аррісайопв Screens call ? 
New Sourcing | basic info | Upset 
requisition | | Delays: 
without Candidate 
warning lost 


Stressed | Hopeful 
Meets with Posts to his 
| 


recruiter own Linkedin Frustrated | Frustrated 

to discuss | to increase Gets the Sometimes, no 

what job exposure to slate from | visibility for what's 

requires his own recruiter going on 
network 
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INTERVIEW (-2-4 weeks) OFFER (-1-2 weeks) 


(1): Schedule interviews 

(2: Conduct 1st round of interviews 
(3): Conduct 2nd round of interviews 
(4): Decision after interviews 


Ф 2) ө 


о 


Internal 


E-mail Video conference 


(1): Send verbal offer 

(2): Negotiate verbal offer 

(3): Final offer approval 

(4): Formal offer 

(8): Negotiate / sign 
o 2) 


ө 4) 


Рһопе 


(5) 


Email, 


PDF 


Signs 
final 
offer 


Excited 

Receives 

signed 
offer 


Excited 


BEFORE 


ONBOARDING 


Excited 


Stressed 
Ina 
period of 
silence 


Frustrated 
... if the 
candidate 
drops out 


Emails, Total Email 
meetings| call phone са!!! Rewards 
Schedule ө Пар * Waiting 
changes /^ orvies and waiting. 
di Hopeful | Hopeful questions Excited р 
i Interviews | Interviews ! Receives H 
Y with HM | with HM | offer арру 
_ Receives 
~O TS Stressed | Anxious pd 
; i offer 
Frustrated Frustrated © Negotiates | Waits for 
Scheduling Upset Waits to terms offer 
takes a Finds position is hear back Upset 
long time not a good match Rejected 
e.- 
OK ү Hopeful Excited 
Waits for \ Interview Verbal 
scheduling | goes well offer is Relieved 
554 Stressed given Tired Written Anxious 
pens = ji | offe. 
à б» Frustrated 119510 Negotiates er Offer 
Lost H hit keep terms putinto | letter sent 
candidates Upset 5 at candidate system 
due to P didates Уатт” Negotiation 
reschedule| Loses |Сапа!@а165 failure 
candidate | needed 
How did 
candidate 
aS get this 4 
Excited N Excited 1 > 
Uses own \ Found 
interview | candidate í 
structure \ Hopeful Relieved 
Stressed iS үсе Тейз Stressed Receives 
Preps for No Standard ecides | recruiter ; notification 
reps for Жш on offer Works with ; 
interviews, interview > to extend feet offer is 
’ guide and with panel, ff fecrunerto approved 
lis panel 9! Frustrated олег j pp 
pulls p assessment no other negotiate 
together — — ! Passed on | guidelines terms 
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Receives 
signed 
offer 
from HR 


Frustrated 
... if the 
candidate 
drops out 


Future state recruiting journey Financial services company 


| Phase У SOURCE / SEARCH (1-2 weeks) SCREENING (2 days) 


Step (1): Brand building and planning (1): Assess application 
Step (2): Job description creation (2): Schedule screening call 
Step (3): Job posting (3): Conduct screening call 


Step (4): Digital application 


LD 9 | O0 | O6 | ee 


LinkedIn | Recruiting | LinkedIn | Application Recruiting | Auto/self Video 


Touch points 


etc: system etc. portal portal scheduling | conference 
Strong attraction of tech talent, tech-enabled Transparent process and easy 
screening for an easy start screening scheduling 
Candidate Excited Relaxed Excited 8 
ехрегіепсе Өө” Gets Gets Schedules | Respected 
- Curious pre-screened clear view recruiter Takes 
Actions, | Interested Discovers | ViaChatbot | of process call screening 
thoughts, feeling я "m 
at key moments Watches company suitable car io 
for new openings position connect 
| | 
Leverages candidate pool and firm's Tech-enabled screening 
reputation, collaborates closely with HMs speeds up process 
Ө--ө--ө-ө-ө--ө-- 
Весгийег Ргерагеа Confident Confident Informed Focused Prepared Connected 
i Access to Involved in | Forms plan Monitors Focuses Gets Assesses 
experience - Р 
candidate | HM interview | to source metrics on А! screening candidates 


ool training for | pre-screened | scheduled | on screenin 
p g 
requisition candidates | automatically call 


Creates JD from templates, support recruiter Visibility on the shared portal 
with sourcing and screening guidance keeps HMs informed / involved 


e- 
о-ө” © -© 4 
Hiring Excited 
manager Prepared | Prepared | Uses robust Hopeful Informed 
experience Plans ahead | Stays active JD templates Provides Gets visibility 
and acts on own with minimum | additional to screening 
fast professional edits screening on digital 
network guidance dashboard 


EXHIBIT 10.4 
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INTERVIEW (1 week) 


(1): Schedule interviews 

(2): Conduct 1st round of interviews 
(3): Conduct 2nd round of interviews 
(2): Decision after interviews 


Ф 


Auto/self 
Scheduling 


o Ө о 


Internal 
meetings 


Video conference 


Streamlined process with highly 
coordinated interviews 


-@ °° = 


eo > 


OFFER (1 day) 


(1): Extend verbal offer 
(2): Negotiate verbal offer 
(3): Final offer approval 


: Formal offer / sign 


Ф (2) 


Phone E-mails, Total 
call phone call Rewards 


Ө o 


E-mail 


BEFORE 


ONBOARDING 


Fast offer process and continuous cultivation 


Excited 
In control Interviews with Hopeful Receives | Reassured | Anxious Receives Becomes 
Schedules multiple interviewers Waits for verbal Reviews but relieved | final offer member of 
interview decision | decision andasks | Waits for community 
via TA questions | final offer before 
start 


Communicates on digital portal "4 visibility 
and support, tracks metrics throughout 


Fast offer 6. and continuous cultivation 


> 


-®© 


Informed Informed 

Keeps continuous Tracks 
communication progress, 
feedback 


Well-planned and documented interview 
process to keep the ball rolling 


— - 
Excited 
Conducts interviews with 

Hopeful | clear process and assets | Hopeful 

Prepares 
for and 
interviews decision 
meeting 


e 9 — 


Extends 
verbal 
decision 


Informed, empowered 
Communicates on digital 
portal with multiple parties 


-© 


Informed, 
empowered 
Sees through 

post-offer 

activities 


Stays close during offer and post-offer with automated 
prompts, personal touches to keep candidates engaged 


Excited 


Reaches out 
Callibration | after verbal 


decisiona 
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Hopeful Excited 
Stays close Reaches 
during offer steps out to 


ШШЩ ст 


Excited 
Continues 
to cultivate, 
welcome 
new team 
members 


Career progression for а data scientist 


Professional service firm example 


Junior 
DS 


Data 
scientist 


Lead Principal 
DS DS 


Senior 
principal DS 


Appren- Requires Mostly Leads Leads large, Provides technical Leads 
ticing technical self-sufficient technical complex tech- delivery leadership & DS in 
guidance workstreams nical delivery firm-wide expertise Firm 
DATA Performs basic data quality assessment Identifies data insufficiency, data quality or data 
EXPLORATION Performs basic exploratory analysis bias issues and shapes solutions to address 
Continues to shape new technologies to surface 
data insights 
DEFINITION OF Has a growing understanding of the Understands long-term objectives for digital 
THE ANALYTICS benefits and drawbacks of different transformation; how current work fits into an 
APPROACH methodologies, languages and assets overall technical readmap 
Collaborates with business domain leads to craft 
an ambitious vision for next 1—3 years, and leads 
the technical thinking in scoping and developing 
technical readmaps 
Helps identify technical skill gaps 
Combines latest advances in literature to 
overcome challenges that off-the-shelf DS/ML 
libraries cannot accommodate 
FEATURE Can confidently construct/code features Validates both business domain and functional 
ENGINEERING defined by herself/himself or others, features across predictive models but also key 
working collaboratively with data features guiding optimization constraints 
engineering colleagues 
APPLICATION Performs analytics tasks with minimal Identifies opportunities for, and pioneers the use 
OF ANALYTICS guidance of new and innovative methodologies 


TECHNIQUES/ 
METHODOLOGIES 


OUTPUT AND 
VISUALIZATION 


ENGINEERING 
STANDARDS 


EXHIBIT 11.1 


Has good knowledge of a number of 
leading methodologies and can apply 
appropriately, with limited guidance 


Can learn new methodologies quickly and 
apply with guidance 


Starts gaining familiarity with internal assets 


(e.g., Kedro) 


Generates plots/outputs that display 
relevant data optimally to guide problem 
solving, with guidance on choice/design of 
output 


Writes good, accurate production code 
with limited guidance 


Has growing familiarity with libraries and 
assets 


Follows software development and 
MLOps best practice with guidance 
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Holds the bar for technical validity of approaches, 
and defends that bar even under time/resource 
pressure 


Engages in R&D and external collaborations in 
order to identify trends and opportunities 


Shapes DS-related communications to senior 
leadership, translating complex technical outputs 
into compelling, clear, and contextualized 
messages 


Builds trust with senior business and technology 
leaders through breadth of knowledge and 
strategic thinking 


Proactively identifies opportunities to develop new 
technology assets and plays lead role in their 
development 


Aware of and ensures adoption of any latest 
significant advances in DS/ML technology and 
tooling 


Is responsible expert across multiple pods for 
coding best practices 


Example of dual career tracks 


Archetype Description 


Expert leadership For those individuals who prioritize developing best-in-class thinking on a topic, 
refining their craft, and shaping customer expectations 


People leadership For those individuals who prioritize leading large teams, connecting work across 
departments, and managing customer expectations 


Executive leadership For those individuals who want to lead both People Managers and Experts to 
shape the structure, priorities, and work of the whole organization 


DATA SCIENTIST EXAMPLE 


ІС - Individual contributor PL — People leadership 
EL - Expert leadership EX - Executive 


Junior Data Scientist 


Assoc. Data Scientist 


Data Scientist 


Senior Data Scientist 


Lead Data Scientist 


Data Science 
Manager 


Assoc. Principal, Data 
Science 


Data Science 
Sr. Manager 


Principal, Data 
Science 


Senior Principal, 
Data Science 


Director, 
Data Science 


VP, 


Chief Data Science Data Science 


Chief Data and Analytics Officer (CDAO) 


EXHIBIT 12.1 
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Example of pod launch bootcamp 


Team working sessions [J Reflections 


DAY 1 DAY 2 DAY 3 


9 a.m. Kick-off (Welcome | Define team Define MVP Understand Share-out/demo 
from leadership, working (Align on devops and how with leadership 
why are we here, agreements/ definition of an to use it (CICD (Team demonstra- 
broader norms MVP, story pipeline and tion, gather 
transformation mapping, draft developer feedback from 
story) product MVP) platform) leadership) 

10 a.m. 

Bootcamp 
Agile overview Stakeholder retrospective 

11 a.m. and simulation mapping 
(Align on (Stakeholder 
definition of Agile, | communication Create backlog Define sprint 
mindsets and framework, (Align on cadence 
behaviors, Agile develop definition of 
practices for stakeholder map) backlogs, 
teams. practice user 
Simulation) story writing) 

12 p.m. 

Create product | 7 

1 p.m. Setting roadmap (Align Sprint 1 planning 
mission/vision on definition of a Definition of Refine user (Review user. 
(Align on the product roadmap, ready/definition of | stories for 2-3 stories for sprint 
mission, crafting draft product done sprints 1, revise а 
а vision гоаатар) (Estimate estimation, clarify 
statement) stories, refine acceptance 

acceptance criteria) 

2 p.m. criteria, plan 

2-3 sprints 
р ) (Optional) 
Teamwork time 
.m. : (Team continues to 
эрт Align on OKRs Estimation (What refine artifact 
= efine artifacts, 
(Align on Understand our are story points? implements 
definition of technology and Estimation stakeholder 
OKRs, OKR. data architecture techniques and Prepare for engagement model, 

4 p.m. writing practice, environment planning poker, share-out/demo schedule sprint 

draft team OKRs) (What is relevant practice user (Artifacts created evont. Setup teain 
for the target story estimation) during the week, | Collaboration tools) 
digital solution) demo format) 

5 p.m. 

Retrospective Retrospective Retrospective Retrospective 
> p P Note:Teams may 
modify this 
А ; f В schedule based on 

6 p.m. (Optional) (Optional) (Optional) (Optional) team availability, 
Teamwork time Teamwork time Teamwork time Teamwork time time zones, and 
(Refine artifacts (Refine artifacts (setup team (Dry run for demo, | in-person/virtual/ 
created during created during collaboration setup demo hybrid operating 
the day) the day) tools) logistics) model 

EXHIBIT 12.2 
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Sample learning journey for a cloud engineer 


Role specific 


Platform specific Ways of working 


Increased level of competency 
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— NOVICE COMPETENT EXPERT — 
——————— a ee! SEE (тшшш шш ш A (калы сты лы лас =н 
What is Containers for Serverless Cloud risk Efficient Cloud 
Cloud? production computing development 
[rr — ÀÀ1À асса | [LÀ Cloud cost (———— 
Virtualization and Applying Cloud Cloud security management Hybrid Cloud 
deployment to business specialization шш“ Modernizing 
models scenarios Elastic CSP Applications with 
[== Anthos 
== ишаа Cloud SRE Cloud 
Intro to DevOps Cloud ER Infrastructure 
and Containers development — MA—E—— ë 
— | ——— Logging, Reliable CSP 
>| CSP Cloud Еөвелігі СР Monitoring, and ^ Cloud 
(с fundamentals Cloud infrastruc-  ObServability in Infrastructure 
a ture scaling and CSP Cloud 
-l к============= í 
automation a 5 
i Engagin 
Essential CSP Getting started in "à ч id 
Infrastructure —— stakeholders 
) Р Terraform for 
Foundation Getting started CSP Cloud 
with Kubernetes 
Bt engine 
Essential CSP Scrum 101 
Infrastructure І | 
Core services Working with 
cross-functional MVP mindset 
teams 
Problem solving 
Embracing Agile 
fundamentals 
SSS 2) ра Ге —„ | 
Define business Create and Set up and Deploy and Cloud 
problem manage Cloud configure Cloud Manage Cloud Architecture: 
statement for resources environment in Environments Design, 
> implementing CSP Cloud with CSP Cloud Implement, and 
п. 
с. Cloud Perform Manage 
foundational Automating Optimize Costs 
infrastructure Infrastructure on for CSP 
tasks CSP Cloud with Kubernetes 
Terraform Engine 
EXHIBIT 12.3 


Agile is a superior development approach 


Benchmark of experienced agile teams performance versus teams using all other 


development methods 


CHEAPER 


Productivity increase, 
Developed complexity units! per 
FTE/week 
Agile: 
+27% 


Non-agile 
baseline 


Collected and validated data 
for 1000+ SW releases 
(technical characteristics, 
staffing levels, milestones, 
defect levels, etc.) 


FASTER 


Lower schedule slips, 
Projects not released on time 


Non-agile 
baseline 


Agile: 


-30% 
Developed ап 


historical 
performance baseline 
based on project 
complexity and effort 


BETTER 


Fewer residual defects, 
Software bugs? 


Non-agile 
baseline 


Benchmarked 
performance 

against a peer 

group of selected Agile 
industry projects -70% 


1. Units that possess a high amount of structure or information, often across multiple temporal and spatial scales 
2.A problem causing a program to crash or produce invalid output 


Source: Numetrics industry software database — 1,321 projects and analytics through patented normalizing algorithm (2021) 
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Agile cadence and performance management 
ceremonies 


START Ceremony e Artifact ERE 


Quarterly cadence © 


Ф. 


Quarterly 
business review 


@ M Biweekly cadence ө 
M 
@ Sprint 
v 
retrospective eo 
Launch 95 Sprint 
Pod review 
v POD 
Roadmap 


Working 
Product 


250 
Daily Uo y 


huddle 
402 


Sprint 
planning 

Sprint plan 
—— 
Backlog 
refinement 
(Pod-defined ES 


cadence) 


Definition of Pod norms 


Ready/Done and agreements 


EXHIBIT 13.2 
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Example of OKRs 


Software solution that supports enterprise HR services 


Objectives Key results Timing 

11 Develop a cohesive, consistent user experience Q2 

(1) across all three personas with 100% of user journeys 

implemented 

Delight our current 

clients and deliver 4.2 Drive error-free customer reports release rate to 95% Q1 

positive moments from ~80% 

that matter every 

шше 13 Increase average NPS to -40 from -13 for product V Q2 
24 Introduce and drive adoption of self-serve features to Q3 

(2) ' reduce call volumes by 10% 

Reduce direct 2.2 Automate reports for queries that receive more than Q3 

costs associated 100 service requests per quarter 

with the product 
2.3 Reduce hosting costs by 20% Q4 
3.4 Match product uptime to SLA (99.995%) for the entire year Q4 

t 3.2. Reduce number of critical incidents to 63 (from 83), and hot Q3 

ШРЕК ТЕЛЕ fixes by 50% (from 4 to 2) 

retention by stabilizing 

die esc 3.3 Achieve defect intake rate lower than defect resolution rate Q2 


EXHIBIT 13.3 
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Agile ceremonies 


CEREMONY 


Backlog 
refinement 


Sprint 
planning 


Daily 
huddle 


Sprint 
review 


Sprint 
retrospective 


Quarterly 
business 
review 


DESCRIPTION 


EXPECTED RESULTS 


FREQUENCY 


Elements in the backlog 
are prioritized and 
fine-tuned to ensure they 
are ready for the upcoming 
sprint and the 1—2 
following sprints 


The backlog contains a number 
of user stories that have been 
prioritized, are well document- 


ed, and are comprehensive 


enough to potentially form the 


next sprint backlog 


Every sprint 
(2 weeks) 


Used to ensure team 
agrees on the proposed 
amount of work, which is 
composed of several 
elements in the sprint 
backlog 


Prioritized epics and stories’ 
are allocated to sprints 


Assumptions, risks, and 
dependencies have been 
identified 


Every sprint 


Serves to assess sprint 
progress and identify 
possible barriers 


Every team member has 1+ 
tasks assigned for the day 


Status of user stories/tasks 
has been updated 
Blockers, if any, have been 
raised 


Daily 


Opportunity for teams to 
present new functionalities 
developed in the newly 
finished sprint 


Feedback is provided to 
update or add future user 
stories 


Every sprint 


Used to assess sprint 
productivity and identify 
improvement opportunities 
as well as strengths for the 
team 


Team strengths have been 
identified 

Solutions to areas for team 
improvements have been 
identified and assigned 


Every sprint 


Performed at project start 
and every quarter to align 
OKR and product 
roadmap 


Prioritized epics and stories 
are allocated to sprints 
Assumptions, risks, and 
dependencies have been 
identified 


OKRs for next quarter are set 


Every 
quarter 


1. Epics: large chunks of work that deliver full functionality (includes multiple stories and spans multiple sprints) 
User stories: a feature from perspective of end-user 


EXHIBIT 13.4 
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Streamlining of management forums 
from OBR implementation 


Change 
Readiness 


Tech and 
Production 
Readiness 


Operational 
and Tech 
Risk 


Funding 


Measuring 
the impact 


EXHIBIT 13.5 


BEFORE QBR IMPLEMENTATION 


U.S. bank example, 
by nature of governance 


Stakeholder Identification 


Project Intake (service-catalog based) 


Direct Intake (x5) (custom requests) 


Change Advisory Board (x2) 


Business Case Review (IT component) 


Architecture Review Board 


Production Readiness 


Subject Matter Expert Forum 


BAU Review Committee 


New Initiative Review Committee 


Technology Product Committee (x12) 


Business Risk & Control Meeting 


Technology Leader Approval Meeting 


Business Case Review (IT component) 


v 


~ 


Monthly Investment Committee 


GH5SBHSSBHB поо gH 


Monthly Line of Bus. Financial Review v 
From: 
Forums 30+ 
Hours ~75,000 
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| x | Forum eliminated 


Forum kept 
Forum modified 


AFTER QBR IMPLEMENTATION 


Scrum @ Scale Cadence 


Change Advisory Board (x1) 


Architecture Board 


Production Readiness 


Quarterly Business Review 


2nd Line of Defense 
Risk Oversight 


Monthly Line of Business 
Financial Review 


Line of Business Strategy 
Steering Committee 


To: Change: 
8 -75% 
-50,000 -35% 


Building blocks of agile operating models 


Customers/Users 


Pod 
Practice or 
Chapter х 


WHAT WE MEAN 
Pod: Self-sufficient, cross-functional team with end-to-end 
accountability to deliver a product, experience, or service. 


Alternate taxonomy: squad, cell, agile team 


Product (or Journey) Pods: E2E delivery of a service 
or solution to a customer or user. 


A collection of product pods is called a Product Group, 
Domain, Portfolio, Tribe, or Town 


Platform Pods: Grouping of similar technology assets, people, 
and funding to provide a (reusable) service to product/journey 
pods. 


A collection of platform pods is called a Platform, Tribe, or Town 


Practice or Chapter: Organizational construct responsible for 
professional development of employees (separate from 
day-to-day direction done by the pod). 


Alternate taxonomy: guild, communities of practice 


EXHIBIT 14.1 
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Product (or 
Journey) Pods 


Support 
and control 
functions 
Platform 


түң J Pods 


EXAMPLES 


(see below) 


Yield optimizer 
Pricing recommendation 
Customer on-boarding 


Website product search 


Customer 360 data product 
Machine learning suite 
Core system 

Infra provisioning 


Data engineers 
Software engineers 


Product owners/managers 


Three operating model design options 


Digital factory 


Product & platform 


Enterprise-wide agile 


Description 


Typical 
configuration 


Main 


advantage 


Prerequisites 


EXHIBIT 14.2 


A separate digital unit 
that builds digital 
solutions for business 
units using modern 
agile ways of working 
and multidisciplinary 
pods 


10—50 pods 
Touches less than 2% of 
organization 


Simplest model to 
implement 


Alignment of BUs in the 
funding and operating 
model of the factory 


Model brings together 
Business, Tech and 
operations in pods focused 
on improving customer/ 
user experiences 
(so-called product pods) 
and pods dedicated to 
building services for reuse 
(so-called platform pods) 


50-1,000-- pods 
Touches 20-40% of 
organization 


Integrates Business, 
Technology and Ops more 
closely and addresses 
evolution of platforms 


IT modernization 
required (e.g., talent, 
architecture, cloud, 
DevSecOps) 
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Extends benefits of 
agility beyond 
digital/tech, as many 
core operations and 
functions can benefit 
from agile collaboration 


1,0004 pods 
Touches 80% of 
organization 


Creates enterprise-wide 
agile culture 


Organizational 
readiness for a full 
agile flip 


Digital factory operating model 


Hospitality example Estimated FTEs (internal and external) 
DOMAINS 
Discovery Brands Convert App Etc. 
25-30 15-20 45-50 25-30 — 
PODS 


Product owners 


Tech Lead 
Developers QA 


Data scientist > 
Ф 
Data eng. D © 
o ? E 5 
© J E ? 
të] =i fs + ae 
: б д [o] о о [5] 
Designers е £ “Esto fo 
o Em 1 Ф Ф Z 
е ЕЗ т о о о 
© © = | | | 
Scrum с % ЕЗ ЕЕЕ 
Agile coach IH KE EU B Bs E EN EN EN ES 
9 ЖЕНЕ ES EN ERN ES ERN EJ E 
olo Fa Sac d оо og 2 
и ЕШ Е ops ceSETS ЕСЕ Ес 
: т cas ОУ“ FL FL 
Architecture al ES ES сз с $85]l351]3512 
Of Oo Fz > а тт f fo fo 


TECH AND DATA PLATFORMS 


ые ЕНЕН 


1. CMS = Content management system; 2. DAM = Digital asset management; 3. ОТА = Online travel agency; 4. 
API = Application programming interface; 5. СОР = Customer data platform 


EXHIBIT 14.3 
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From project funding to persistent funding 


PROJECT FUNDING 


PERSISTENT FUNDING 


BUDGETING Budgeting done by project 
on a yearly basis 


Annual budget target is set at enterprise 
level and by domain (not by project) 


FUNDING Up to 50% of funding is getting 
absorbed into unplanned or lower- 
priority work 


Additional funding released upon 
hitting milestones/stage gates 


REVIEW Projects are reviewed and 
prioritized yearly or biannually 


EXHIBIT 14.4 
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Quarterly review and prioritization done 
during QBR 


Product and platform model 


Example for an international bank 


Enterprise 
Strategies 
BU egies Strategies Strategies Strategies Strategies Strategies Strategies 
Strategies & OKRs & OKRs & OKRs & OKRs & OKRs & OKRs & OKRs 
Branches 
Distribution i 1 RMs RMs Whole- Sales 
stributio Advisors, Advisors, | 
mobile Glia RMs Salers 
salesforce 
о 2 
9| |5 
m 15 е = [v |o = |с | = [о |с =la |o = |с |с 
g | Journeys “| lel elele 21818 elele elele elele 
ш 9 =fe Е|ЕДЕ SEIS БЦЕДЕ 212415 515 |5 
z с age oo |o o|o!o ороо ООО ooo 
= 5 = E ш іш ш ш [ш |ш шіш ш ш іш ш ш ш үш 
[e] = © \ сч |е |с NJN |с NIN | CN [е | QN NIN [OQ 
5 о с ш |ш ш шуш ш шш ш шуш ш шуш ш 
e 
5| Segment Segment Segment Segment Ops Segment Segment 
2 : 
Б Орв Орв Ops Segment Ops Ops 
9 | 
[ащ 
Channel 
Partners 
B Customer engagement Front office 
= co 
8 9 CX eTrading 
So 
as SR 
so Servicing Digital client 
=x V 
с © z 
E 2 Ops & Core product Lifecycle ops. 
[*] " 
7a A z Innovation 
o~ Risk Credit T 
o9 Liquidity 
z 
Е Data as а Service (DaaS) Data mgmt. 
та " 
т on Common Payment as a Service 
o 
Clee Protect (cyber, AML, fraud) 
=O 
$t 
TS i 
rvi 
шо Сог. Corporate services | 
Colleague experience Compliance 
ao 
8 E : Platform and practice enablers Enablement 
sg Enabling : 
ES Infrastructure 
о. 
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How risk management is embedded 
in agile operating model 


US bank example 


5 Е Control functions 
e Domain lead Risk management 
ES professionals Risk oversight 
@ @ 6 @ 6 | Compliance Chief compliance 
| officer 
Product Product Product Product Product | 
Owner Owner Owner Owner Owner | Credit Chief credit officer 
9. 
@ @ | Interest rate Head of market 
! — Liquidity risk 
э о суо o > 
| 
| 
| Operational ERM oversight 
І Reputational 
Risk generalist --------------------- -! Cybersecurity 
Conducts risk assessment during release Fraud 
planning and mobilizes second-line risk Strategic 
professional as needed Technology 
Others 
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How risk assessment is embedded in 
the development process 


Every quarter 
(if needed) 


Risk identification 


Risk assessment based on comprehensive risk 
taxonomy to identify risks at a granular, epic level 


Risk professionals assignment 


Risk professionals are assigned to 
co-design/consult risk-mitigating actions 


During sprint 


Refined risk assessment 


Risk assessment can be retaken to update risk 
identification and rating as more clarity is obtained 
on the epic 


Risk mitigation workflow 


Risk mitigation stories identified and automatically 
generated into backlog of the pod 


Mitigation executed 


Stories assigned to pod members, business or risk 
professionals to execute mitigation 


MONITORING 


Initial assessment 


Automatic triggers 
for involving 
specialized control 
functions 


Post-sprint 
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Reporting and compliance 


Risk mitigation actions documented for compliance, 
and sprint retrospective discussion 
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Compliance reports 
Automatically 
generated and 
configurable reports 


Four archetypes of agile units 


CROSS-FUNCTIONAL UNITS 


Example: Product teams (pods) 
Used in digital factory, and P&P 


Product owner steering 


Marketing 


Data Science 


Data 
Engineering 


Design 


SELF-MANAGED TEAMS 


Example: Contact center 


Each team is accountable for the end-to-end 
experience of a subset of customers 


KPI-based steering 


FLOW-TO-WORK 


Example: Functional experts 
Deployed to teams with the most pressing needs 


Special project teams Pool experts 
Project team 1 ч. 
experts 
А A 


Project team 3 
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NETWORK ELEMENTS 


Example: Distribution 
(stores, sales teams) 


Light Coordination 


Daily 
Huddles 


Team 2 


Enterprise-wide agile operating model 


Midsize telecom operator 


Agile organizational building blocks 


Bl Cross-functional pods Ш Self-managed teams ШШ Flow-to-work pools Network elements 
Contact Centers Channel distribution and delivery units 
Contact Centers: Retail Sales & Sales & 
in/Use Stores Service South Service North 


Channel 


and Delivery Contact Cent Business Professional Field 
1 Premium Hubs Services Delivery Delivery 
Units 
Contact Centers: Service Billing & Collections 
Outsourced Operations Operations 


Channel 
Domain 
Voice & 
с 
a Segment Product Broadba Managed 
"с | Domains Domains Data 
Е ER 
o Wholesale Digital IT Р 
a Services Services 
Billing IT Path-to- Network Physical 
Platforms Enablement production Evolution Infrastructure 
Domains IT Security Network & Data & 
Applications Infrastructure Automation 
Functions 
EXHIBIT 14.9 
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The skills of a great product owner 


Customer- 
experience 


grounding 


Ability to design 
customer-centric 
experiences 
throughout the 
customer 
decision journey 


EXHIBIT 15.1 


Market 
orientation 


Ability to deeply 
understand market 
trends, partner 
ecosystems, and 
competitive 
strategies 


Business 
acumen 


Comfort with 
business 
strategy, portfolio 
prioritization, 
go-to-market, 
pricing, tracking 
key performance 
indicators and 
financial metrics 
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Technical 
skills 


Ability to go 
deep on 
technology 
trends, architec- 
tural questions, 
stack control 
points, road- 
maps, and 
managing the 
development life 
cycle 


Ability to lead 
teams, communi- 
cate with diverse 
groups, and 
influence change 
throughout the 
organization 


Product management expert and 
managerial career tracks 


CAREER PATHS 


ШІ Individual Contributor 
ШШ People Manager 


Associate 
PO 


Expert track 


Product 


owner Management track 


ROLES AND RESPONSIBILITIES 


Scope of 
responsibility 


Works on cutting-edge technologies, products, 
or customer experiences 


Works on flagship or strategic products facing 
Severe competition 


Works on strategic products important for critical 


customers (B2B) leaders, and pod members 


Principal 
РО 


E- 


Distinguished 


PO 


Works on managing profitability across a 
flagship product or product group (or journey) 


Leads work on multiple features or products, 
by providing vision and managing 
performance 


Organiza- Able to rally support from senior Able to rally support from senior leadership 
tional leadership across functions on new across functions 
influence product experience vision and ideas Able to manage a budget to deliver on 
Able to build and lead a rockstar specific projects and ideas 
cross-functional team Able to build, coach, and performance 
Sought by other POs and colleagues as manage a team of POs 
a mentor and educator Coaches fellow POs and other colleagues on 
Helps in recruiting, retaining, and best practices 
coaching fellow POs and engineers Responsible for recruiting, retaining, and 
coaching POs 
Market Presents thought leadership and is a Serves as the external face of the 
influence published author on technical topics product/product group 
Develops strong relationships with Develops relationships with strategic 
ecosystem — OSS developers, partners, etc partners, influencers, and customers 
Communicates product vision to customers Communicates product vision to customers 
and partners with ease, and brings on and partners with ease 
early adopters Able to attract the best talent by creating a 
compelling employee value proposition 
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Product Owner: Skills framework 


Critical skills for POs 


CUSTOMER 
EXPERIENCE 


Design thinking: 
Take empathetic and 
design-led approach 
to problem solving and 


Customer centricity: User engagement and 
Focus on learning feedback: Regularly engage end 
from customer needs users to elicit and implement 


and pain points to feedback 


MARKET 
ORIENTATION 


BUSINESS 
ACUMENT 


TECHNICAL 
SKILLS 


PRODUCT 
LEADERSHIP 


decision making drive value 


Industry and competitor trends: Aware 
of relevant market and technology trends, 
informing product strategy 


Driving Innovation: Drive innovative 
ideas, and provide input for business 
development 


Product vision and roadmaps: Develop 
product vision and iterative roadmap based 
on user needs 


Go to Market: Assist with GTM plan for 
effective product growth and adoption 


Prioritization: Maintain prioritized 
backlog of work, and define smart 
goals focused on value of users 


Impact tracking: Define and track 
outcome metrics that align to product 
strategy and business goals 


Technology planning and execution: 
Devise feasible solutions with experts for 
MVP and releases 


Risk management: Manage risk, 
engaging others to align on outcomes and 
business needs 


Ways of working: Make right 
trade-offs with teams for continuous 
improvement 


Backlog management: Create and 
manage backlog with team(s) for user 
needs 


Effective execution: Own, drive and 
prioritize user-centric product outcomes 
collaboratively 


Communication: Manage stakeholder 
and sponsor communications 


Inspire and Influence: Be a thought 
leader who generates followership through 
ideas 


People development: Build high 
performing team culture through 
passion, trust, collaboration 


Collaboration: Co-create 
features and facilitate alignment 
on dependencies across teams 
to drive value 


SAMPLE SKILL PROGRESSION - USER ENGAGEMENT AND FEEDBACK 


Ability to collect and consider 
some feedback, without 
paying attention to ideas that 
throw a plan offtrack 


Regular interactions with 
customers and end users, 
with some data analysis 
feeding back into backlog 


DEVELOPING PROFICIENT EXPERT 


Close and consistent collaboration with end users and 
designers from product idea origination to operational 
deployments — ensuring validated customer insights 
impact the backlog 
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Field & Forum product management 
upskilling program 


Example for a US financial institution 


FORUM 1 FORUM 2 FORUM 3 FORUM 4 


Discovery phase Viability phase 1 Viability phase Il Build phase 
Learning Understanding Empathizing with the Communicating Converting product 
goal problem space and user and defining the | value and engaging idea into execution 
defining product “Ном” (innovative and | with customers апа 
vision not incremental) engineers 
Forum 5 hours 5 hours 5 hours 5 hours 
learning Understanding Portfolio prioritization | Defining and Overview of Build 
problem space (data-backed) measuring success phase & continuous 
and market Understanding user * Product success development 
opportunity approach 


and key unmet needs metrics 
Minimum Viable 
Product mindset 


* Market requirements 


document * User persona * Objectives and key 


(includes methods of | results 
* Competitive analysis research) Ongoing refinement 


Communicating апа and prioritization 


Defining product vision | • As-is journey engaging with 

* Press release and Defining how we want customers * Product backlog 
frequently asked to solve the unmet e Positioning statement | Leadership 
questions need development — 


“Productone-pager Influencing w/o 


e Customer pitch deck | authority 


Converting product Demo day overview 
idea into requirements | and objectives 


e Business model e To-be journey 


canvas e Prototype 


* Roadmap 


* Product requirements 
document 


training 


Core Market orientation Business acumen Business acumen Soft skills 
PO skills Business acumen Customer-experience | Customer-experience | Technical skills 
grounding grounding 


Customer-experience Business acumen 


grounding Technical skills Soft skills 


Technical skills 
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Different design competencies 


Service 
design 


Design 
research 


UX 
design 


CORE COMPETENCIES 


CORE METHODS* 


Skilled in analytical parsing of root causes 
and secondary effects from a frontstage 
and backstage delivery of a product or 
service 


Can think systematically, i.e., systems 
thinking — seeing components as part of a 
larger whole 


Ability to negotiate between business, 
technical, and user needs and goals to 
achieve satisfactory solution 


Business model canvas 
Blueprints, ecosystem maps 
Feature prioritization matrix 
Problem-solving frameworks 
Leading design workshops 


Tools: Figma, Sketch, 
Adobe Creative Suite 


Skilled in conducting qualitative research, 
e.g., contextual interviews, diary studies, 
longitudinal work studies, etc. 


Ability to field surveys and conduct 
usability testing 


Versed in best practice methods to ensure 
valid results and synthesis of insights 


Awareness and increasing knowledge of 
analytics and other quantitative research 
methods 


Interview guides 

Surveys 

Personas 

Journeys, workflow maps 
Pathway analysis, with analytics 


Tools: Dovetail, UserTesting.com 


Skilled in human-centered design, predomi- 
nantly for digital solutions but also inclusive 
of service design 


Able to develop coherent solutions that 
address user needs and accords to best 
practices 


Experience concepts, interaction models 
Information architecture, navigations 
Wireframes 

Prototypes 


Tools: Figma, Sketch, 
Adobe Creative Suite 


Skilled in compositional balance, color 
theory, iconography, etc. 


Masters visual design patterns and 
Systems, including but not exclusively 
brand architecture 


Skilled in visual system development and 
documentation best practices 


* Core methods are not exhaustive 
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Brand expressions and extensions 
Mood boards, asset libraries 
Interaction design frameworks 
Omnichannel design patterns 
Visual design 


Tools: Adobe Creative Suite, 
Sketch, Invision 


Range of research methods to 
gather customer feedback 


Q Natural use of product Ё Scripted (often lab-based) use of product 


A Decontextualized/not using product 4» Combination/hybrid 


What people do 
BEHAVIORAL 
ӨШ Eyetracking Ө Clickstream 
Analysis 
@ А/В Testing 
gg Usability 
Benchmarking (in lab) 
Ш Usability Lab Studies ШИ Moderated Remote 
Usability Studies 
Ш Unmoderated 
Unmoderated Remote UX Studies 
. Panel Studies 
Ethnographic Ө True Intent 
Why and Field Studies Studies How ы 
how to fix Y an 
how much 
«—4» Concept/ ——— — —» 
Testing 
Ө Diary/Camera Studies 
4» Participatory @ Customer Feedback 
Design Desi bilit @ Intercept 
esirabili 
А Focus < Studies | — ——* Surveys 
Groups | 
A Interviews 4—4 Card Sorting ———> A Email Surveys 
ATTITUDINAL | 
QUALITATIVE (Direct) What people say QUANTITATIVE (Indirect) 
QUALITATIVE QUANTITATIVE 
Answers the “Why” Answers the *How Many and How Much" 
Deep understanding of user behaviors and emotional Quantify data and generalize results from a sample of 
needs population 
Uncovers needs users don't even know Opinion-based and validates hypotheses or solutions 
Observation-based; ability to co-create with users with statistically reliable data 
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Process and tools to go from design to development 


ГГ Tools Channels 


SYNTHESIZE WORKSHOP TEST AND 
RESEARCH AND DESIGN VALIDATE 
AND IDEATE CONCEPTS PROCESS 


GENERATE 
PACKAGES DELIVER 


Lower 


Web 


| 

| 
ШЕШ 
Y 

Higher LS 


fidelity 
Web 


In-person 
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Four foundational shifts to upgrade 
architecture for digital 


Mobile Web 


t н 


САМ 


Physical 
channels 


t 


Ө 


From 


(з) From fixed to evolving 


i i 


Applications 


APIs and management platform 


1 


Data 


i 


+ 


From point- 
to-point to 
decoupled 


manual to Data products 
automation 
(via code) Curated data vault (by domain) 

Raw data vault 

Real-time streaming 
Core processing 
systems 
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From batch to 
real-time data 
processing 


Systems of 
engagement 


Unified 
data and 
analytics 

core 


Modern application architecture! — overview 


Example of consumer application architecture for a global medical device company 


Gateway & Front Door 


GraphQL / API layer 


Data products Analytics / 
Al models 


Customers Products Locations 


Data lakehouse 


Consumption Data 


Curated Data 


Raw Data 


Core systems / systems of record 


1. Serverless, microservices with Data lakehouse storage and Data Science capabilities 
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Gateway & Front Door 


Controls traffic and adds 
security 


GraphQL/API platform 
Resolves what services 
to call to return exact data 
needs 


Data products 

Each data product has its 
own storage and scaling 
capacities, allowing the 
data needs to scale/evolve 


Data lakehouse 


Data from core systems 
and Apps get stored in 
data lakehouse. This then 
follows a process of 
cleansing and structuring 
the data for consumption 


Analytics/Al models 
Advanced analytic/Al 
models generate 
insights for the app to 
consumer 


Core systems/ 

systems of record 
Systems that run core 
business operations of the 
company 


Modern application architecture – 
detailed schematic 


Example of consumer application architecture for a global medical device company 


Mobile App = countries 


Tracking 
and logs 


Gateway & Front Door Front Doors (CDN/WAF) 


API Management Services 


GraphQL / API layer Q 


Apps 
analytics 
(Application 
Data ра ша Ша Insights) 
products |= $ E cg 
= Œ| CUSTOMERS zu = *| LOCATIONS 
Customer Location e 
(Function Apps) Customer Event (Function Apps) Location Event th 
ag Storage py Ingestion Storage p Ingestion python 
b> & S 22“ (Event <b> 38 25, 4) SS= (Event 
(Azure Га; Hubs) (Azure WE Hubs) 
——€ Cosmos z Cosmos = 
DB) % DB 
Azure ) Azure ш; 
Cosmos Cosmos 
change change 
feed feed 
PRODUCTS LEGAL 
о 
Product | Event Legal Event 3 £ 
(Function Apps) Product Ingestion (Function Apps) Legal Ingestion =, m 
+, Storage ra (Event D Storage г--- (Event T 
=>“ ж ыт, Hubs) rr G ES Hubs) =o 
— o E — o i 
= - 
- = = 
Azure E Azure 2] 
Соѕтоѕ Соѕтоѕ 
сһапде сһапде 
feed feed 
Data lakehouse 
SQL Endpoint 
Consumption Data i = 
Gina naa Transform jobs EN 
г 
nasoma Schema and Data Validation Jobs 
Raw Data 
DLT Ingest Jobs 
Core systems/systems of record 
SAP PeopleSoft NetSuite 


Companies need to be aware of local regulations when deciding on where data is housed 
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Messaging vs. streaming 


Message/event Logic Action 
An incoming email Spam filter Send to junk mail folder if 


email is detected as spam 


STREAMING 


Group of messages/events Logic Action 


өөө Ф ‘@ 


Group of transactions Fraud detection Block credit card if 
algorithms fraud is detected 
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Typical architectural options for 
building digital solutions 


Increasing complexity 


Typical 
architectural options 


Banking 
examples 


Engineering 
considerations 


Build new cloud- 
native application 


Use core system 
application "as is" 
(with a wrapper) 


Build new cloud-native 
features to replace part of a 
core system application 


Migrate and refactor core 
system application to cloud 
to enhance performance 
innovation 


Change entire core system to 
enhance performance and 
reduce unit cost 
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Build mobile credit card 
onboarding application with 
fewest clicks possible 


Use "KYC — Know your 
customer" application in core 
banking system 


Build new credit decisioning engine 
to replace core system credit risk 
assessment 


Migrate and refactor entire credit 
risk assessment application to 
cloud to accelerate time to market 


Change entire core banking 
System to reduce unit cost and 
enable broad new suite of features 
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Provide data to flow from 
core systems to onboarding 
app and credit analytics 


Use API to access KYC 
System application and 
ensure real-time 
performance needs 


Build new credit decisioning 
engine with access to 
customer data in real-time 


Decide on best migration 
option (see cloud 
migration options) 


Run legacy and new core 
System in parallel and 
establish data migration 
strategy 


Six options for disposition/migration 


of legacy applications 


Q Retire 
Applications that are no longer useful and can 
be retired within the next 1—2 years 


(5 Веригсһаве e 
Application that is end-of-life from a technical 


or business perspective and needs to be 
replaced with a cloud-native SaaS! 


9 Rehost ("lift and shift") О 
Application that is lifted and shifted to cloud to 


quickly implement a larger legacy migration thus 
enabling exiting of data centers 


Replatform 

Change of application platform in order to 
achieve some tangible benefit without 
changing core architecture 


Refactor/Rearchitect 

Change of architecture, adding features, 
Scale, or performance that would otherwise 
be difficult to achieve in current app 
environment 


Retain 

Applications that are not ready to be 
migrated or whose migration does not 
make sense in terms of benefits 


1. If replacing an application, you may build a bespoke application or configure an SaaS application depending on SaaS 


market maturity and business needs 
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Software development life cycle (SDLC) 


4—————————————— Continuous integration — — — — — ——» “-:- Continuous 
deployment 
-E "- B gu 

^^ | 
І | 
|! | 
l І 
| l 
І | 
LoS SaaS SSS eae See Sa Feedback == === === Seo SS Se eva 
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The family of xOps practices 


DEVELOPMENT 


Provide sandboxed 
environment(s) for 
exploration and 
experimentation 


MLO 


PRODUCTION 


Provide steady-state 
environment 24 hours/day, 
7 days/week, 

52 weeks/year 


DevOps/DevSecOps 


ps 


Each practice and related process 
provides different benefits across 

the development, production, and 
data management stages 


——— DevOps/DevSecOps 


Accelerate secure delivery of new 
features from development to 
end-users 


tt 


ty 


production platforms 


DATA LAKE 


Provides data access to both the development and 


DataOps 


'_— MLOps 


Develop, maintain, and monitor 
performance of machine learning 
models and related data pipelines 


——— DataOps 
Accelerate delivery of new data 
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assets by automating data quality 
and reliability 


Testing strategies - definitions 


A 


Increasing 
cost and 
time for 
testing 
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Penetration 
testing 


Regression 
testing 


Performance/ 
Load testing 


Acceptance 
testing 


End-to-end 
(system) testing 


Integration 
testing 


Unit 
testing 


Verifies robustness of an application to cyber attacks 


Ensures that existing software applications are not 
adversely impacted when a new functionality is added 


Ensures working condition of application under varying conditions 
by simulating multiple users accessing the application concurrently 


Ensures that the application works correctly from a user’s 
perspective 


Ensures entire application as a whole behaves as expected 


Verifies the communication paths and interaction between 
components to detect interface defects 


Tests individual units (modules, functions, classes) in 
isolation from the rest of the application 
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Python code pipeline — continuous integration 
and deployment - example 


CODE Python Engineers make code changes 
D GitHub Source control/code stored 
Y 
e CircleCl Detect code changes 
EE Ө Pylint Validate code conforms to standards 
ө Pytest Validate code behavior by running test 
CONTINUOUS E Ө SonarQube Validate code quality 
INTEGRATION 
-ө Sphinx Autogenerate documentation 
Docker | : : 
-ө Атагоп ЕСВ Code is packaged and stored in repository 
-© Selenium Run integration tests 
© Argo Detect code changes 
Ө Сһесктагх Check for vulnerabilities 
Copy Docker image to Kubernetes 
Ө Argo : 
CONTINUOUS production platform 
DEPLOYMENT Ө Kurbenetes Expose as API to test code behavior 
Ө Selenium Validate that API is working 
© Kurbenetes Activate API for users 
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Example of a developer platform 


Agile Pod 


Developer portal 


Access Sandbox 
dashboard 


Create team 
environment for pod 


(10096 automated) 


Access 


All tools accessible 
through single 
workbench 


Simplify building 
applications 
Facilitate common 
actions from 
workbench (without 
having to be experts in 
underlying tools 
directly) 


Extensible 
Addition of new 
tools/features 
possible over time 


1a Setup sandbox 2a  Discover/access data 
1b Deploy prebuilt patterns 2b Tools to write code 
1c Setup source control 2c Search existing code 
1d Configure CI 2d Track experiments 
le Setup collaboration tools 2e Build code 
1f Automate security scans 2f Publish 

2g Monitor 

2h 
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Control апа auditability of the production environment 


! PRODUCTION 
· ENVIRONMENT 


CI/CD 


Infrastructure 
as code 


scripts 
Configuration Security policies Access controls Ingress/egress 


Version Control 
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Sample monitoring dashboard for a digital solution 


CPAT APPLICATION DASHBOARD ABREX SCORE TODAY СОМРАВЕБ 


WITH 1 WEEK AGO 


TRANSACTIONS OVERVIEW Since 1 week ago Since 7 hours ago vs. 1 week ago 

9.43M 0.124 0.211 : 

Total Average Slowest 10%/ a 

transactions duration duration (90%) nm E : 


5pm 7pm 9pm 11рт 
e Duration e Previous duration 


ERRORS OVERVIEW Since 1 week ago 
TOP FAILED TRANSACTIONS Since 1 week ago 


0 01 7% 1 56 К WebTransaction/Go/POST/run. binary 0.36% 
E о . 


WebTransaction/Go/POST/run/:section/:template 0.13% 
2 Р 41% 5 А 
Failed transactions in% Failed transactions ане ЕНЕ тустер Бой 
WebTransaction/Go/POST/calculate/batched 0.012% 
LATEST ERROR TRANSACTIONS BY DAY MOST POPULAR TRANSACTIONS 


Since 1 week ago WebTransaction/Go/POST/Calculate 2.74M 


A bo ut Webtransaction/Go/POST/data 2.74M 


Webtransaction/Go/POST/batchgeo 1.05M 


5 hours ago жән ШШ [| | Webtransaction/Go/GET/curencies 42.8К 


Feb7  Feb8  Feb9 Feb10 Feb11 Feb12 Feb13 


VM OVERVIEW 1/31-2/7 CPU UTILIZATION PHYSICAL MEMORY THROUGHPUT 
60 зок 


20.7 61.5 i " = 


Ауд. СРО Avg. physical o 
utilization memory 


ок. 
o 5 7 9 
5pm 7pm 9pm Tipm 5pm 7pm Эрт 11рт em Pm Bm 
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Improving security by "shifting left" 


From: Leaving security to last — Security check after deployment of software 


A 


Detecting security issues late can have : 
- В : uon Security 
high reputational and financial impact 


To: "Shifting left" on security — Security checks and procedures are 
embedded in every step of the SDLC 


Package Deploy Operate 
| 1 н А ч 
| l І І 
І І І І 


i 
4 


Earlier remediation can help avoid catastrophic problems later 
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Embedding DevSecOps into delivery 


Examples of security testing executed throughout software development life cycle 


Detect for malicious 
Integrated Development 
Environment plugins or 
third-party components, 
and check for sensitive 
information in code 


Run Dynamic Application 
Security Testing to 
discover vulnerabilities in 
applications being built 
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Enforce access 
controls, scan for 
undocumented ports, 
and conduct automated 
penetration testing 


in third-party 
components using 
Software Component 
Analysis 
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Continuous integration and continuous delivery — — — ——————*» 


=ш 


Check for vulnerabilities 
in packaging technology 
before deploying to 
production 


Reverify vulnerabilities Run Runtime 
Application Security 
Protection to identify 
threats at runtime, and 
monitor for unusual 
application behavior 


AI/ML model lifecycle 


Feedback 
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Importing relevant datasets (extraction from the overall data) 


Understanding the data structure and statistics 


Cleaning and sanitizing 


Data labeling, exploration, and enrichment to identify potential patterns and features 


Feature analysis 


Cross-feature relationships and correlation analysis 


Model prototyping and feature importance evaluation 


Model training and validation with different parameters and algorithm combinations 


Model evaluation and testing 


Integration with real-time APIs & data sources 


Data preprocess and enrichment 


Model prediction 


Post processing 


Initiation of actions or response 


Autoscaling 


Model containerization 


Addition of automation frameworks 


Monitoring 


Model maintenance 


Performance validation 


Continuous improvement 


User support 
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From business domains to data elements 


Insurance company example 


Solutions 


Help protect 


Use cases 


assets Digital vault 

2. Help optimize 
нии coverage 

services 

Enable micro Property 

policy & service protection 

enablement advice 


Help prepare 
for emergencies 


Risk tracker 
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Help manage Life event 
account & policy accommodations 
Value-added 


service adviser 


Fee-for-service 
adviser 


Micro policy 
recommendations 


Comprehensive 
Service adviser 


Protection tips 


Rapid 
communication 


BUSINESS 
DOMAINS 


Data domains 
Catastrophe 
& safety data 


Asset market 
data 


Detailed 
documentation 


Overall assets 
& track record 


Customer 
digital footprint 


External customer 
attributes 


lll Example solution, 
use case, and 
associated data 
needs 


Data elements 


NOAA hurricane risk 
index by US counties 


USGS earthquake risk 
index by US counties 


FEMA flood probability 
by location 


Real estate price data 


Real estate 
purchase history 


Neighborhood index 


Insured profile 
& demographics 


Automobile market 
value data 


Insurance 
preferences 


Interaction 
channels 


Nine dimensions to assess data quality 


e Accuracy 

Degree to which data 
should match the 
agreed source 


а) Completeness 
Extent to which field must 
be populated, and the 


required breadth, depth, 
and history exist 


Availability 

Extent to which 
current and historic 
data is available for 
analysis 
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Timeliness 

The timescale within which 
the data should be 
refreshed, and the 
acceptable systems "lag" 
when values change 


Uniqueness 

Extent that data should be 
uniquely stored in one 
place, and be unique for 
one customer 


Security 

Extent to which data is 
held securely, subject to 
access restriction, and 
recoverability 
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Consistency 

Extent to which identical data 
must have the same value 
wherever it is stored or 
displayed 


Coherence 

Extent to which data 
definitions remain similar over 
time so historic data has the 
same context 


Interpetability 


Extent to which clear 
definitions for data are in 
place-enabling easy 
understanding 


The legacy data setup in many organizations 
can be complex and inefficient 


Data pipelines designed for Different technologies are 
batch and real-time delivery are employed for each use case, 
fragmented and duplicative. adding expense and complexity. 


Flow of data 
----------- > 
Systems Data Use-case-specific Use-case-specific 
of record platform data sets technologies cases 


Be: ian im 
m 
E 


Core 


processing 


systems Investing portal 


data 


А Predictive 
cross-selling model 
External — 9 
data 
та Predictive 
m churn model 
d Financial 
Unstructured | герогі 


Industry data 
ecosystem 


Data for each domain, such as the customer, 
is inefficiently reworked for every use case; 
quality, definitions, and formats vary. 


Source: Veeral Desai, Tim Fountaine, and Kayvaun Rowshankish, "A Better Way 
to Put Your Data to Work," Harvard Business Review, July-August 2022 
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A data product approach results in 
standardization that saves time and money 


Systems Data 
of record platform 


Flow of data ——» 


Data Consumption Use 
products archetypes cases 


Core 


processing 
systems 


External 
data 


Unstructured 


data 


Digital banking 


Digital 


applications app 
= Investing portal 
Customer КОО 
= analytics Predictive 


cross-selling 
model 


Reporting = 


Predictive 
churn model 


Financial 
External report 


data sharing 
Employer/ Industry data 
agent ecosystem 
Discovery Data 
sandbox exploration 


Source: Veeral Desai, Tim Fountaine, and Kayvaun Rowshankish, "A Better Way to Put Your Data to Work," 


Harvard Business Review, July-August 2022 
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Consumption archetypes for data products 


ARCHETYPE 
Digital 


applications 


Advanced 
analytics systems 


Reporting 
systems 


Discovery 
sandboxes 


External 
data-sharing 
systems 


REQUIREMENTS 


EXAMPLE USES 


Specific data cleaned and stored in a particular 
format and frequency (e.g., delivering access in 
real time to event streams of GPS or sensor data) 


A marketing trends app 
or vehicle tracking app 


Data cleaned and delivered at a 
certain frequency and engineered to 
allow processing by machine learning 
and А! systems 


Simulation and 
optimization engines 


Highly governed data with clear definitions — 

managed closely for quality, security, and changes — 
aggregated at a basic level and delivered in an audited 
form 


Operational or 
regulatory compliance 
dashboards 


A combination of raw and aggregated data 


Ad hoc analysis for 
exploring new use cases 


Adherence to stringent policies and agreements 
about where the data sit and processes for 
managing and securing data 


Banking systems that 
share fraud insights 


Source: Veeral Desai, Tim Fountaine, and Kayvaun Rowshankish, "A Better Way to Put Your Data to Work," 
Harvard Business Review, July-August 2022 
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Example of a pod that develops data products 


Data Product Owner 


Leads pod in development 
of data product 


Tech delivery 
(engineers, IT leads) 


Provides infrastructure Manages the relevant 
and DataOps expertise data domains 


o product 
analyst(s) 
Brings voice 
of users/ 
customers 


Data engineer(s) 


Data steward(s) 


Designer 

Creates an easy to 
consume experience 
for users (if that is a 
consumption pattern 


considered) 


Data architect 
Designs the overall 
data architecture 
for the product 


Carries out data 
engineering work 
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Data product development approach 


“6S” data product recipe — example 


Sharing the data 
and creating 
enabling reports, 
dashboards, etc. 


Scoping where to 
focus development 
to create value 


Upfront planning 
= “Sprint 0” 

to develop the 
product backlog 
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Structuring the data 
to enable use cases, 
e.g., architecture 


Selecting the data 
to curate over time 


Agile sprints to 
iteratively develop 
the product 
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Sourcing the data 
and measuring its 
current state 


Steering the product 
by confirming roles 
and processes 


Develop plan for 
next release 


Data architecture archetypes 


CLOUD-NATIVE DATA LAKE 


Centralized serverless Optimized for (very) large- 
architecture leveraging object scale data marts for SQL 
storage and compute which analytics and modern AI/ML 
can scale independently applications 


CLOUD-NATIVE DATA WAREHOUSE 


Flexible foundation to add 
capabilities (e.g., DWH, 
real-time) but beginning to be 


seen as “legacy” architecture 


Very good 


performance on vast 
majority of enterprise 


analytical workloads 


Very well supported by 
tooling and required SQL 
skills are plentiful among 
data users, analysts, and 
data experts 


Handles the most 
complex batch data 


jobs and high-volume 


streaming data (e.g., 
loT) 


Less mature tooling but 
rapid pace of technical 
innovation 


Highly scalable and Implements modern 
agile SQL-driven data transformation 
platform with driven by SQL or 
independently scalable Ul-centric ETL tools 
storage and compute (e.g., dbt, Matillion) 
LAKEHOUSE 
Combines benefits of Leverages nextgen 
Data Lake and DWH storage technologies 
into an integrated (e.g., Delta Lake or 
platform for analytics Iceberg) supporting 
(e.g., Bl, SQL) and ACID transactions on 
AI/ML use cases top of object storage 
DATA MESH 
Emerging archetype; Decentralized 
fundamental departure architecture approach 
from centralized IT and focused on data 
data functions products fully owned by 


business domains 


Data products are 
curated for quality, 
cataloged, and 
accessed via 
well-defined data 
services 


Data products are built 
leveraging any of the 
data architecture 
archetypes defined 
above 


DATA FABRIC 
Emerging strategy for The Fabric is stitched 
creating a unified data together through 
environment across the metadata into a secure, 
Enterprise's data unified data 
landscape management layer 
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Meant to solve 
multicloud scenarios 
for heterogeneous 
data sources and 
infrastructure 


No existing tooling 
currently enables a true 
Data Fabric, it must 
rather be built in-house 


Data capabilities 


BI and 
Visualization 


and API 


and/or GraphQL) 


SQL endpoints 


Ad-hoc SQL Analysis 


Data API endpoints 


(JDBC and/or ODBC) 


^ DATA CONSUMPTION 


DS Development 
Environment 


Model Production 


Environments 


DATA SERVICES 


Publishing/ 


subscribe endpoints 


Management (REST 


Analytics 
optimized data 
(e.g., Parquet) in 
refined zone and/or 


DATA REPOSITORIES 


DS Sandbox 


Relational (e.g., SQL 


Internal operational 
systems 


Mobile and web 
applications 


Metrics and Feature 
Stores (e.g., Transform, 
store, serve, monitor, and 
govern reusable features 


Schedule data processes in 
robust and intelligent way 


for BI and Al) 


Data Federation and 
Virtualization 


PROCESSING 


Train and optimize 


Data Quality, Observability, and centralized 


Data Governance: Catalog, Data lineage, 
metadata for DataOps 


catalog, model monitoring, and 
centralized metadata for MLOps 


ML Model Governance: Model 


Advanced tools: Data Access Control, Data 
Loss Prevention, data privacy, data retention, etc. 


Infrastructure as Code (laC), DevOps and automation, administration, logging, monitoring 


5 
A 
. 5 
[e То) 
O c 
= с 
= NES 
ML Is (e.g. Е 5 52 
ё DS Sandbox Server, Oracle, IL models (e.g., 26 58 
а 4 Postgres) Distributed os 5 > 
п. (for Analytics/ML) бе Ф < 5 
< NoSQL (e.g., KVS kaning £ 25 
Я b REDE d 
= : Document DB, graph optimization, GPU Re T 2 E 
a Refined zone grap compute) со |45 92 
ОВ) в © Stc 98 % 
Trusted zone uto O8 о о 
Data Warehouse 55 sps ас 
Landing zone (e.g., store of = а BEG E 2 
structured, integrated ао sEg£ аз 
Store data on cheap, reliable data to support BI Transform and 
and “infinitely” scalable media activities, analytics) analyze data g 
in real-time T 
oz 
DATA INGESTION IO 5 
БЕ ah 2 
ax ш О 
a > 4 
T ETS Ed E 
Ingest in Ingest from real-time PII Management Clean, mE =o Е E 
scheduled ^ data streams (e.g., (e.g., detect Ш ag m а. 
h g: , transform, and а О >> те 5 
batches Change Data Secure, and E enrich data in a 5 « f [7] 4 
Capture streams, govern sensitive batches, =< a & > Е tr 
Sensors, transac- data) usually daily <2 40 < = 
tional event data) az ао = = 
DATA SOURCES 
Structured Data Unstructured Data 
Transactional | Structured Other Machine & | Sound, Unstructured | Social Media 
& Event Data | Master & Third-Party Sensor Image, and | Text Data Content 
Reference Data | Structured Data Data Video Data Data 
EXHIBIT 26.2 


80 


Reference architecture: Lakehouse using 
Databricks on Azure 


A 
DATA CONSUMPTION Nog 
“5% 5 
о cS E 
© - 
В! апа DS lab modeling Data driven & Smart 558 = 5 2 
Visualization environment applications and other E z © Е © 2 v5 
Power ВІ, QlikView, DB Azure ML operational systems ® © &® © 3 5 = 
Мей әве Azure ML Studio V Ss E ЕЗ > 
НЕ EM = D L 
SQL Analytics DS Notebooks Ee MEE 8a 
Databricks Notebooks  Kedro ML pipelines О НЕ pss Б Б 
ze EE К 
as SES 3 8 
DATA SERVICES а ЕЁ "ЕЕ $ Q 
Gg CSS Ф 
w — с Ф с о a 
Data АРІ endpoints: Publishing/Subscription Metric and Feature 88 ошо $ о а 
Azure АРІ Manage- endpoints: Kafka topics Store: Databricks c > NS 
ment, in-house APIs | on Azure EventHubs Feature Store,Tecton 9 8 2 б 
е Ф = 
SQL endpoints: Analytics optimized Data Federation / ЕЕ = ôs 
Databricks SQL data: Delta Tables on Virtualization: Denodo, 3 E Е Ф 8 = 
ADLS Trino/ Starburst, Dremio 8 aS 3 
o $ o o z 
2 ЕРО 5 ЕЕ 
DATA REPOSITORIES PROCESSING 28 da on ES 2 
ЕЗ. ЕШ Ке 
со Фо o ОЕ 
5265 5. К 
5 Databricks ML <а 84 22 NL 
4 Соа Sandbox Runtime Еш” 55. £ 56 
i (for DS Lab) 50 z Е Шо 
< - Гуи Azure ML 8 < $15 EM 
E Silver ко [20351 & БЕ 
á Data = О 5 =@ £ 4 EI 
Bronze Bele Lake ты OU o ЕЕ 
Lake Gen 2 ad ES e E IO Es 
Landing zone | (raw data) g 
Databricks 2 
mE (Spark Q z 
Streaming) E 2 [^] 
DATA INGESTION 24 г 5 
< W о 
ш Е a ЕШЕ 
Zo ow = < 
otf =2 IER к 
Azure Data Factory, Azure Events Hubs (incl. = 9 E ч 9 D 
Airbytes, Fivetran Event Hubs for Apache Databricks а О > Е 2 < 
Kafka), Confluent (pySpark, E 2 Е © E = 
Spark SQL) б< аб og c 
DATA SOURCES 
Structured Data Unstructured Data 
Transactional | Structured Other 3rd-Party Machine & | Sound, Unstructured | Social Media 
& Event Data | Master & Structured Sensor Image, and | Text Data Content 
Reference Data | Data Data Video Data Data 
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Components of an effective data operating model 


Organization =™ 
O Ө, 


Talent and 
data-driven culture 


Degree of 


"M Roles and career 
centralization 


pathways 
Leadership Data-driven culture 
structure 9935 
Skill building (Data 
Academy) 
Governance 
and risk DataOps 
Governance (4) Б 74 Process automation 
processes Q and enablement 
Policies Handoffs and 
Stan dante integration points 
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Typical setup across data capability areas 
in a best-practice federated model 


Degree of Where capa- What the center What is delivered in 
centralization’ bilities report provides? federated manner 
Data strategy Chief Data Enterprise data Business unit-level data strategies, 
250- Office strategy, value use cases, and opportunity and 
13% assurance across BUs issue areas 
Data product gy» Chief Data Data product standards, Management of the majority of 
management 55%, Office tooling, and playbook; data products, with cross-functional 
<23% management of some teams comprised of Business, 
enterprise products Data, and Technology resources 
Data Chief Data Enterprise data Ownership and management of 
architecture 75% Office or IT architecture, architectural source systems; identification of 
PS guardrails and review external data needs 
Data Chief Data Deep expertise, pooled Data engineering teams aligned 
engineering 25- Office or IT capacity for use case to business areas (in particular 
50% enablement as data maturity increases) 
Data Бр Chief Data Data governance policy Day-to-day management of data 
governance 25% Office and standards, metrics and domains (e.g., metadata 


dashboards, governance of definition, data quality 
some enterprise domains measurement and improvement) 


Data Chief Data Data operations team that Remediation of issues unique 
operations 50- Office or IT manages issues and data to a business unit or requiring 
75% requests (e.g., for extracts, | deep business expertise 
new datasets) 
Data risk Chief Data Data risk taxonomy; Business unit-specific risks and 
(incl. data Office or interpretation of regulations; regulatory concerns. Business 
Ё >75% 222 : ! 
ргіуасу) Legal/ and policies, standards, and guidance on acceptable risk 
Compliance controls to manage risk tolerance. 


>75% _ 
management, and performance. Business 


Data talent Chief Data Data capability building, Role modeling of target culture 
and culture Office or HR talent strategy and and behaviors. Input on resource 
change management unit-specific capability building. 


1. Typical % of ЕТЕ in the center 
2. Usually in an Enterprise Data Office, but with some areas commonly owned by IT, Legal, Risk, and others 
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Key data roles 


Category 


Data-domain- 
aligned roles 


Data-product- 
aligned roles 


Data- 
architecture- 
aligned roles 


Roles 
that span 
capabilities 


EXHIBIT 27.3 


Role 


Responsibilities 


Data domain steward 


Drives data governance efforts for a given data domain, 
working to improve quality and usability of the data 


Data domain owner 
(sometimes called 
"data owner") 


Is ultimately accountable for data quality in the domain. 
Must "sign off" that the data is accurate; often part-time 
responsibility, or follow a "burst then sustain" model 


Data product owner 


Sets the direction and oversees the development of a 
data product — i.e., a minimum collection of data to solve 
a specific business need (often pulling data from 
multiple data domain areas) 


Data platform owner 


Sets the direction and oversees the development of the 
data platform — i.e., the set of technologies that are used to 
enable consumption, manipulation, and analysis of data 


Data architect 


Establish information architecture strategy for data and 
assist data engineer in ingestion process 


Data engineer 


Build reusable data pipelines, both to ingest data into 
the architecture and to structure data for domains, 
products, and use cases 


Data quality analyst 


Measure data quality against business needs, identify 
issues, and propose and execute solutions to improve 
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Example of data governance framework 
and executive level dashboard 


Global bank example 


FRAMEWORK 


@lssue © Atrisk Ө On target Ө Completed 


SAMPLE TRACKING METRICS 


Metric Data Data 
Name Definition Metric name Results Trend sponsor leader 
Data Tracking Percentage of Milestones Complete 96% © John Jason 
Program progress of data by accountable team (owner) (47/49) 
governance 
progress program Percentage of Milestones at Past e 4% ө John Jason 
implementation Due by accountable team (owner) (2/49) 
Data Measure of Launch data governance forums @ 100% е Kate Kate 
policy and compliance for the required for business-as-usual (10/10) 
standard data governance data governance 
li policies and 
compliance Standards 
Data Measure of data Number of Open Data Defects e Open Data Q Kate Kevin 
quality quality from Issues 
business process 243 of 27,671* 
and data provider 
perspective 
Data skills Measure of the Priority hiring at 8796 (94/108) Q Kate Marvin 
and talent state of skills and leadership and one level 95% (103/108) 
talent needed to down data roles filled 
deliver the data 
program 
Data risk Tracking risk Percentage of VaR impacted by Q 6995 Q John Susan 
reduction within adjustments (rolling 3 months avg.) 45% Target 
data use cases 
Reduction of total expense 21% ($12.1B) О John Susan 
variances within Use Case 1 Reduced 
29% Target 
Reduction 
EXHIBIT 27.4 


85 


Influence model in action 


Example: Driving the adoption of a revenue management solution for an airline's cargo 
business for its 250 cargo sales reps 


Leadership engagement and role modeling Compelling change story and communications 


Involve the head of the cargo business in key Communicate in company newsletter the value of 
development milestones of the solution new revenue management solution for customers, 
airline, and employees 


Showcase the solution at annual sales conference 


Role-based trainings and skill building Measurement and performance 


Train 250 cargo sales reps globally on how to use Measure adoption of solution through frequen- 
the new application cy of app usage 
Provide on-call support for first 3 months of rollout Include adoption measure in performance review 


of senior sales executives 


EXHIBIT 28.1 
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Business model shifts created by 
introduction of new digital solutions 


Examples 

SALES 
Direct field sales o » С) Е-соттегсе 
Business model Right-sizing of Increase size of Integration 
implications field salesforce customer service of IT inside 


over time group e-commerce team 


REVENUE MIX 
Product e » Q Services 


Business model Need for field service Customer contract length 
implications support and complexity increases 


OPERATIONS 
Manual assembly СӰН С) Cobot' assembly 


Business model Right-sizing of direct New collaboration between 
implications labor and quality control cobot design and manufacturing 
over time operation teams 
CAPEX / OPEX MIX 
Low capex, қ 
high орех @ » ө High сарех, low орех 


(e.g., due to investments іп 
new digital solutions and 
resulting automation) 


Business model Capex intensity grows Maintenance investments 
implications required (can be in people, 
analytics, or both) 


1. Cobot: a collaborative robot that is capable of learning multiple tasks so it can assist human beings, versus an 
autonomous robot, is hard-coded to repeatedly perform one task, work independently, and remain stationary 


EXHIBIT 28.2 
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End-to-end process impact assessment 


Airline example 


Optimize plane cargo sales through increased utilization and pricing 


Airline developed a set of Al-based solutions to help its cargo sales organization maximize 
utilization and pricing for its passenger airline cargo space 


| 


EXAMPLE UPSTREAM IMPACT EXAMPLE DOWNSTREAM IMPACT 


End-to-end processes: How is the process affected? 


Sales reps need to know which flights have More time required at airports to load/unload 
available capacity and at what price more cargo 
Performance management: How to track performance? 
Reset sales target as more and more cargo can New targets and incentives for additional 
be sold passenger baggage 
Organization and skills: How are people affected? 
Sales reps need to understand how to use the Airport Cargo operators need training in optimal 
new revenue management solution palletization procedures 
Mindsets and behaviors: How to bring people on board? 

Sales reps need to embrace the change [ | Better cross-functional collaboration between 
cargo and passenger revenue management 
teams 
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Define the scaling sequence 


Mining example 


Business Unit A Ө Existing Ө Emerging © Critical gap 
A Business Unit B : 
Ф Ф o o 
O o x S Ў 
М, © © e © o 
сё 92 SO FF FS FF 
Site E Ice MOS > EE Sr SOS ds ЖУ EF 
| 4 ее Se $ 9 “8 
o 
© - 
= | Site A ө ө ) 
1 І 
ы А Site B e © ) 
© А Site G 
І 
Б Site F | Site C өөө ө 
© 
g A | йер 9 ө e e ө 
g ensB Site H 
= ite І | = _ 
ғ | Site E е ө O ө O ө 
ui 
Site C 
| Site F ( o e e 
Site B | 
| Site G © © ө e @ @ 
Site A й : 
SiteJ Site | ! Site H еее ө 
А | 
Site | e o o ө ө 
Ease ofimplemention — . — | - 5 
(6 dimensions to the right) Site J e ө ө e C 
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Different ways to follow the scaling pathway 


Example type Define which Determine the 
solutions to sequencing of 
scale and units 
where 

RES Set point Sequence 

Mining optimizer concentrators 

Mining company by potential 

developed a set Scale across impact, IT 

point optimizer all 12 maturity, and 
solution for its ore concentrators sensor data 
concentrators availability 

. Scale bundle of Sequence 

Automotive solutions plants by 

Automotive potential 

company developed Scale across impact and 

family of quality vehicle platforms similarity of 
control solutions for platforms 
different products 

(i.e., systems and 

components) 

Airline Revenue All routes 

Airline company management prioritized 

developed a revenue | Solution equally 


management solution 
to help its 250 cargo 
sales reps globally to 
maximize cargo 
revenues on its 
commercial airline 
network 
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Scale across all 
1,200 network 
routes 
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Select a 
scaling 
archetype 


Linear 
waves 


Exponential 
waves 


Big bang 


Approach 


Implement site by site 


Start at every site with data 
assessment, customization, 
training, then launch 


Build custom solution for 
site 1 and communize data 
model in sites 2 & 3 to 
enable more rapid 
implementation on site 3+ 


Roll out across plants 
producing same product 
with a lead plant, follow by 
waves of 2,4,8+ plants 


Build custom solution for 
one product platform, 
standardize approach for 
product platforms 2 and 3 
to prepare for scaling 


Roll out training to all 
cargo sales reps 


Develop production 
version of solution for all 
routes 


"Flip the switch" with 
solution integrated into 
backend cargo planning 
system 


Types of digital and AI solution based on degree 
of standardization 


DESCRIPTION 


EXAMPLE 


DEGREE OF 
STANDARDIZATION 


COMPONENTS 
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CUSTOM SOLUTION 


Solution to solve a 
specific problem. 
Custom solutions 
sometimes reuse 
code snippets, but are 
generally built from 
Scratch 


Specific analysis to 
investigate a root 
cause for deteriorat- 
ing equipment 


10% 


Data (typically offline) 


Model (often 
developed in a 
notebook and rarely 
put into production) 


Solution to solve a 
problem that is common 
across multiple units 
(e.g., plants, markets or 
BUS), but requires 
unit-specific customiza- 
tion. A core code-base, 
UI, and delivery recipe is 
leveraged and 
maintained at the 
enterprise level 


An Al-based advisory 
System to optimize 
production yield in 
plants 


60-90% 


Data (frequently online) 


Core codebase, 
modeling framework, 
Ul 


Delivery recipe and 
deep SME support 


User training & 
adoption support 


Enterprise product 
management 


MLOps and ongoing 
performance mgmt 
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STANDARDIZED 
SOFTWARE PRODUCT 


Standalone 
enterprise software 
application that 
serves multiple end 
users with little to no 
customization 


Statistical analysis 
tool suite 


>90% 


Data (frequently online) 


Standard software 
package 


Enterprise rollout and 
user training 


“Helpdesk” support 
Enterprise product 


management (internal 
or 3P) 


Recipe for effective assetization 


Diagnostic guide 
Step-by-step guide to identify, 
size and prioritize deployment 
opportunities. Includes а 
standard approach to impact 
assessment 


Operations and support guide 


Step-by-step instructions on how to 
run and maintain asset, roles & 
responsibilities, escalation 
protocols 


Delivery guide 


Step-by-step methodology to 
deploy the asset — including 
standard and customized 
components 


Not exhaustive 
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Code building blocks 


Modular and reusable components 
(may apply to many use cases) 


Analytics pipeline 
Prebuilt, easy-to-configure, 


end-to-end code for a specific 
use case 


Standards for code building 
and collaboration 

Document defining cross-program 
standards and collaboration 
guidelines for developing analytics 
applications 


Documentation of 

domain knowledge 

Description of the use case, where 
the value is, and learnings about 
modeling the process (е.9., 
process description, operational 
KPIs, issue trees) 


MLOps infrastructure 


Technology stack for application 
deployment, monitoring, perfor- 
mance management 
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Experts for delivery/scaling 


Subject matter experts, data 
scientists, business translators 


Capability-building program 
Definitions of what the roles 
and responsibilities are, training 
program to build or reinforce 
capabilities 


People to maintain/innovate 


Product owner, ML engineers, 
enterprise product owner 


Organization structures 


Governance, how teams are 
formed and the roles interact, 
and relationship to other 
organizational units 


Example of a modular architecture for a 
setpoint optimization solution 


Base layer 

Horizontal platform services 

Typically 30% of overall solutions 

Fully reusable services 

©? Data pipeline manager, data 
exploration tool, ML suite 


Platform, Infra as code, 
DevOps pipeline 


ЕЕЕ 


Use case layer Unit specific layer Core layer 
Components built to solve Toolkit configuration Use case agnostic components 
specific use case Typically 20% of overall solution — Typically 30% of overall solution 
Typically 2096 of overall solution Some customization Little to no customization 
Customized for the specific unit 
by delivery teams 

@ Use case specific UI --, Trained models & & Dashboard & reports 


constraints 


Ñ Setpoint optimizer | 7 Dashboard connectors 
Features specific to r= 
Use case specific O a unit/process Optimizer library, pipeline 
features < components, simulation 
> Root cause analyzer engine 
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Deployment times reduction through assetization 


Mineral processing and power generation examples 
Number of weeks to deploy solution 


Hardening Development РОС B Prep 


Set-point optimization application Set-point optimization application 
in mineral processing operations across power generation fleet 
36 20 


6 -65% 


Site 1 Site 2 Site 3 Site 1 Site 2 Sites 3—10 
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Digital and А! transformation performance 
management architecture 


VALUE CREATION POD HEALTH CHANGE MANAGEMENT 
Measure impact of digital Measure health and Measure progress in building 
solutions on core maturity of pods new capabilities and 
business/operational KPIs mobilizing the organization 
METRICS Operational КРІѕ Pod maturity KPIs Capability building and 
change management KPI 
i: 4 YN ЕШ Customer adoption (96) Pod staffing adequacy # of pods mobilized 
Online sales (% of sales) OKR achievements Employee engagement 
Process yield (%) Agile/DevOps maturity Talent hiring/upskilling 
Cross-sell rate (%) Release frequency Milestone achievements 
UNIT OF Solutions and domains Pods Specific capabilities, 
ANALYSIS leadership, employee 
engagement 
2158371 C-suite, domain leaders Domain leaders and pod C-suite and transformation 
FOR owners leader 
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Classic business operations KPls tracked in 
banking digital transformations 


Example from investor reporting by a top international bank, 2016-2020 


Are my apps being used by customers? 
% of digitally engaged customers 


100 
80 


60 
43 50 


40 = 


20 


2016 2017 2018 2019 2020 


Is it easy to buy my banking products online? 
% of total sales 


100 
80 
60 


40 
2 36 
22 : 
20 


11 


2016 2017 2018 2019 2020 


Are transactions coming out of 
branch network? 
% of total transactions in branches 


100 
80 
60 
40 
26 23 20 
20 а 
б 16 14 
2016 2017 2018 2019 2020 
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Are processes being automated? 
Headcount in branch network 
100 = 2016 


100 
100 
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78 
80 92 


72 
60 
40 


20 


2016 2017 2018 2019 2020 


A value driver tree to identify where 


digital solutions impact KPI 


Retirement insurance example 


New business 


sales 
# of plans at 
— Total plans г 
— # of plans lost 
__ # of participants 
Average # enrolled 
REVENUE —— of participants — 
penplan | # of eligible 
employees 


OPERATIONAL KPI POD OKR 


— # of proposals 


__ # of plans going 
out to rebid 


L- Retention 96 


3t of eligible 
| employees 


% approved 


Solution 1: win/ 
retain plans 


Solution 2: Drive 
enrollment 


Time to fill application 


Steps to complete application 
# documents required 


% plan with data pre- 
population enabled 


% employee info covered 


Recordkeeping 
[— fees Pod 1 and 2 OKRs 
= Feesonregular | 
money In — Plan levelfees Solution 3: match fees 
to cost increased 
| Fees on IRA |_ Ancillary Fees 
Rollovers 
|  Revenueper | 
participant . Stable value 
| Share of prop placement 
fund 
L— PGIM placement 
А e e e е 


Tracked and reported by business domain 
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Tracked and 
reported in digital 
transformation 


performance mgmt. 


Followed by pod and can 
be tracked by digital 
transformation 
performance mgmt. 


Business/operational KPls linked to pod OKRs 


Case example: OKR mapping - Driving retirement insurance enrollment 


Solution business case 


400,000 Solution will reduce 2/3 of completed Average margin $100 million 
abandoned application applications per participant of | EBITDA 
applications abandonment rate from typically become $500 
last year and 20% to 5% resulting in enrolled resulting NPS = 50 
enrollment 300,000 additional in 200,000 
NPS of 10 applications and industry additional 
leading NPS of 50 enrollees 
Journey target 
Objectives Key results V1 - year 1 V2 - year 2 V3 - year 3 
Key result 1.1: 
cU БЕ. ШЕ 
Pod 1 documents required 
Reduce time to fill 
application by 60% 
Key result 1.2: 
40 30 30 20 10 


Reduce application 
steps 


Key result 2.1: 


% of plans with АР! 


Pod 2 link to HR system 


Enable employee 
data pre-population 
feature for 50?6 of 


| Key result 2.2: 
plans 


Type of employee 
info pre-populated 
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Basic employee Previous plan Spouse & 
info info dependents info 


Pod performance measurement 


Example from a global wealth management company 


Medium Ё Low 


Bi Elite 8 High 


His dre MONTHLY TREND PERFORMANCE BY GROUP 
In last 30 days In last 30 days 
DEPLOYMENT FREQUENCY 
Average time between 40 Days 


Successful code 
releases to production 
per application 


33.1... 


53 
41 45 45 
35 di 31 
i Т П [| 
20 ll Д a 


Jun Jul Aug «—— Product and Platform Groups ———> 


LEAD TIME TO DEPLOY 


Average time it takes a 20 Days 
code commit to get into a 
production 15 . 
23.9 
1 4 2 10 PEL 19.8 20.0 
° days - 12.0 14.8 із 152 
5 5.0 
Mar Apr May Jun Jul Aug | 
MEAN TIME TO RECOVERY 
Average time it takes 160 Minutes 
to recover from a 382 
failure in production 140 
249 
149 E ч 
тїп 97 94 116 123 132 
100 10 35 
Mar Apr May Jun Jul Aug 
| CHANGE FAILURE RATE 
Average percentage 4 % 4.0 
of deployments 
causing a failure in 
production 2 19 17 2.4 
14 
о a М LI oa ГІ o5 11 
1 ° 2 2 о 0 2 о o = um ИШ 
Маг Арг Мау дип Jul Aug «— — Product and Platform Groups ———> 
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Pod maturity measurement 


@ Very low (50% or less) @ Low (51-60%) @ Medium (61-70%) High (71-80%) 


O apod @ best/worst pod 


Very High (81964) 


Enablers for deploying Average 
agile at scale score Range 
30% 40 50 60 70 80 90 100 
STRATEGY | | | | | | | | 


Shared vision 73 ————————————————99-«5——————— 


Dynamic resource allocation (659 e 


Customer centricity 


STRUCTURE 
Reporting structure 


Roles & responsibilities 


Governance eA ---- 2202 veo) — — 


Workforce sizing 7596 e 


and location 


PEOPLE 


Leadership 7% —— orrea 


Talent management 68% e ао oC) 


Culture 80% @ @ 
Informal networks [ I. Cu 
T. О, 
and communication 26 
PROCESS 
Linkage mechanisms 78% @ @ 
Team processes/ E 
779% 
delivery methodology de e =з чм 
Planning & 
22 ТА 
decision processes ie ө d 
Performance management 7396 @ Ө @ 
TECHNOLOGY 
Supporting 80% @ ap T 


Systems and tools 


Delivery pipeline/ 
DevSecOps 


73% ————————AM-—0—9o-e6-5— — —— 


Architecture evolution 


9% өс) 
IT infrastructure 69% | e 526) 


апа operations 
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Transformation tracking through stage gates 


Domain reimagination phase 


SOLUTION INCUBATION SPRINTING/DELIVERY 


Yearly planning + QBR process 


Solution Solution | * 
ideated qualified Business case | 
go/no-go 
T MVP V1 complete 
Solution йш 
ideation 777?» b ” | "С Ей "C E | value 
Adopting and scalin 
Planni Development pang id 
Validation аппа 


Егот 10 Clarity established on business problem to solve 


to L1 Solution ideas surfaced as part of domain reimagination roadmap 


Estimated L3 and L4 dates 


Qualitative assessment of feasibility (e.g., tech, data, change management) 


From L2 Assumptions on improvements of value tree operational KPIs finalized 


Business value driver tree constructed 
From L1 
to L2 Value of the solution with key assumptions to size impacts 


to L3 Feasibility and technical needs completed (tech stack, data, change management to drive 
adoption and scaling) 


The team composition needed, including downstream costs 

Business case (refinement to the financial value and investments; "locking" of the OKR curve) 
Key milestones identified to inform release expectations (e.g., sprint cycles, MVP launch dates) 
OKR for pods finalized and roadmap defined 


Delivery through sprint cycles 


From L3 

to L4 Pod manages execution in Jira while domain/solution lead shares evolution of 
KPIs and KRs in Wave periodically (e.g., monthly) 
MVP solution completed 
Customer/user adoption proven 

From L4 QBR conducted as quarters conclude 

to L5 Trailing KPl/financial impact achieved 
Scale up/roll out: across broader organization 
Further develop the product roadmap and scale as needed 
V1 completed — New cycle starts for V2... 
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Transformation office setup 


CEO/Executive team Transformation Office (TO) 
| 


Transformation workstreams 
| Chief Transformation Officer 


Domain #1 Additional Domains 
Roadmap development and refresh 
Domain Sponsor Domain Sponsor Strategy lead 
TO analysts 
Pods | | Pods | Performance management 
TO Finance lead 


Q TO Finance analysts 


Change Management 
Change management lead 
Communications lead 

HR lead 

Risk management lead 


Admin support 
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Leadership attributes in digital enterprises 


Customer-centricity 
Has the customer at the center of all activities, 


sparing no effort to provide an outstanding experience 


Collaboration 


Collaborates well across functions and business 
units for the benefit of customers and the enterprise 


Sense of urgency 


Acts/reacts quickly, and is sensitive to the needs of 
each situation 


External orientation 


Constantly learns from other companies, partners, 
and customers 
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Test, learn, and grow 


Is able to assume risks to test new innovations and 
views mistakes as a source of learnings 


Data-oriented 
Embeds data in real-time decision making 


Empowerment 


Empowers employees to make decisions and 
creates the environment for it 


Constant delivery of value 


Prioritizes quick delivery of value to the customer 
and improves products and solutions continuously 
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School of Analytics and Technology 


Majid al Futtaim example 


Introduction to analytics & Understanding and applying Power of technology 
technology analytics use cases Understand how technology can 
Understand the importance Lead into a more thorough use improve the way we do things 
of analytics and technology of analytics & technology and get exposed to the latest 
and the benefit it can bring technological trends and threats 


The “school” encourages employees to... 


Embrace | Demand | Challenge | Promote the Push the envelope when 


flexible and new | data-driven analytics use of it comes to applying the 
ways of working support of approach and analytics and | latest trends in analytics 
assumptions | analyses | technology | and technology 


EXHIBIT 32.2 


104 


